JUnit version 4.13.2
.12:11:59.370 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512719362
12:11:59.393 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512719393
12:11:59.422 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:11:59.426 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:11:59.483 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:11:59.493 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:11:59.497 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:11:59.500 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:11:59.702 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:11:59.917 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:11:59.918 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:11:59.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:11:59.922001 11416 mini_oidc.cc:150] Starting JWKS server
12:11:59.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:11:59.925073 11416 webserver.cc:533] Webserver started at http://127.0.0.1:45109/ using document root <none> and password file <none>
12:11:59.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:11:59.925438 11416 mini_oidc.cc:186] Starting OIDC Discovery server
12:11:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:11:59.927067 11416 webserver.cc:533] Webserver started at http://127.0.0.1:34079/ using document root <none> and password file <none>
12:11:59.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:11:59Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:11:59.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:11:59Z Disabled control of system clock
12:11:59.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:11:59.980989 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:11:59.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:11:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal
12:11:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data
12:11:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:11:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:11:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:11:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:11:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:11:59.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:11:59.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/logs
12:11:59.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data/info.pb
12:11:59.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:11:59.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:11:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.62:34839
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.62
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:11:59.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:11:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:11:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:11:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:11:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json with env {}
12:12:00.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.261698 11428 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:00.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.262369 11428 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:00.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.263096 11428 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:00.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.294358 11428 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.294691 11428 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.295017 11428 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.295353 11428 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:00.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.295699 11428 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:00.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.295969 11428 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45109/jwks.json
12:12:00.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:00.331192 11428 master_runner.cc:387] Master server non-default flags:
12:12:00.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:00.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:00.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.62:34839
12:12:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json
12:12:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data/info.pb
12:12:00.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.62
12:12:00.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:00.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:00.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:00.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:00.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:00.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:00.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/logs
12:12:00.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:00.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:00.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:00.332871 11428 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:00.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:00.335093 11428 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:00.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.347527 11434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:00.347560 11435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.462227 11437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.465165 11428 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.118s	user 0.299s	sys 0.819s
12:12:01.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.465443 11428 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.118s	user 0.299s	sys 0.819s
12:12:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.469732 11436 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1113 milliseconds
12:12:01.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.469751 11428 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.471099 11428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:01.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.473658 11428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:01.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.474994 11428 hybrid_clock.cc:648] HybridClock initialized: now 1783512721474946 us; error 59 us; skew 500 ppm
12:12:01.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.476029 11428 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.482826 11428 webserver.cc:533] Webserver started at http://127.11.38.62:44241/ using document root <none> and password file <none>
12:12:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.483682 11428 fs_manager.cc:362] Metadata directory not provided
12:12:01.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.483867 11428 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:01.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.484280 11428 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:01.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.488699 11428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data/instance:
12:12:01.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af3865196ab543a48ce7481dd167f4a4"
12:12:01.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:01 on dist-test-slave-vcgh"
12:12:01.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.489938 11428 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal/instance:
12:12:01.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af3865196ab543a48ce7481dd167f4a4"
12:12:01.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:01 on dist-test-slave-vcgh"
12:12:01.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.497727 11428 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:12:01.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.503615 11444 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:01.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.505039 11428 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:12:01.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.505373 11428 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal
12:12:01.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af3865196ab543a48ce7481dd167f4a4"
12:12:01.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:01 on dist-test-slave-vcgh"
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.505801 11428 fs_report.cc:389] FS layout report
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data/data
12:12:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:01.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.588079 11428 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:01.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.589772 11428 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:01.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.590253 11428 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:01.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.656840 11428 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.62:34839
12:12:01.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.656944 11495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.62:34839 every 8 connection(s)
12:12:01.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.659757 11428 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/data/info.pb
12:12:01.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.665383 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:01.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.668938 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 11428
12:12:01.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.669430 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-0/wal/instance
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.674489 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/logs
12:12:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data/info.pb
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:01.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.61:36393
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.61
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json with env {}
12:12:01.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.678884 11496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } has no permanent_uuid. Determining permanent_uuid...
12:12:01.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.712466 11496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } has no permanent_uuid. Determining permanent_uuid...
12:12:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.715258 11447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:01.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.719488 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:01.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.769060 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 1
12:12:01.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.773397 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:01.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.841861 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 2
12:12:01.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.846196 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:01.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:01.937650 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 3
12:12:01.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.941963 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:01.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.978206 11498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:01.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.978756 11498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:01.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:01.979190 11498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.010591 11498 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.010870 11498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.011077 11498 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.011271 11498 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:02.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.011449 11498 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:02.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.011595 11498 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45109/jwks.json
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.046700 11498 master_runner.cc:387] Master server non-default flags:
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:02.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.61:36393
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data/info.pb
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.61
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/logs
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:02.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:02.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.048210 11498 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:02.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.050294 11498 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:02.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.062475 11507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:02.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.085426 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 4
12:12:02.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.093346 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:02.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.392851 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 5
12:12:02.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.400520 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:02.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:02.948061 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 6
12:12:02.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.977545 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.61:36393: Network error: Client connection negotiation failed: client connection to 127.11.38.61:36393: connect: Connection refused (error 111)
12:12:03.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.465315 11506 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11498
12:12:03.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.519387 11506 kernel_stack_watchdog.cc:198] Thread 11498 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:12:03.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:03.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.519541 11498 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.457s	user 0.564s	sys 0.891s
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.519876 11498 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.457s	user 0.564s	sys 0.891s
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.520246 11509 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1456 milliseconds
12:12:03.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:02.063167 11508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:03.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.521607 11498 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:03.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.521677 11510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:03.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.525628 11498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:03.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.527988 11498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:03.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.529299 11498 hybrid_clock.cc:648] HybridClock initialized: now 1783512723529257 us; error 45 us; skew 500 ppm
12:12:03.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.530046 11498 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:03.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.535591 11498 webserver.cc:533] Webserver started at http://127.11.38.61:42019/ using document root <none> and password file <none>
12:12:03.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.536453 11498 fs_manager.cc:362] Metadata directory not provided
12:12:03.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.536639 11498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.537058 11498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:03.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.541307 11498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data/instance:
12:12:03.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "534e48c5688b4ca6ae635d4f4e5574c7"
12:12:03.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:03 on dist-test-slave-vcgh"
12:12:03.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.542352 11498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal/instance:
12:12:03.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "534e48c5688b4ca6ae635d4f4e5574c7"
12:12:03.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:03 on dist-test-slave-vcgh"
12:12:03.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.548997 11498 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.006s
12:12:03.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.554235 11519 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:03.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.555253 11498 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.555584 11498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "534e48c5688b4ca6ae635d4f4e5574c7"
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:03 on dist-test-slave-vcgh"
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.555949 11498 fs_report.cc:389] FS layout report
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data/data
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:03.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.607043 11498 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:03.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.608623 11498 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:03.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.609135 11498 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:03.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.675596 11498 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.61:36393
12:12:03.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.675669 11570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.61:36393 every 8 connection(s)
12:12:03.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.678411 11498 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/data/info.pb
12:12:03.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.684019 11571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:03.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.684511 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 11498
12:12:03.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.684872 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-1/wal/instance
12:12:03.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.687054 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:03.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal
12:12:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data
12:12:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:03.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:03.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/logs
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data/info.pb
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:03.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.60:33275
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.60
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:03.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:03.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json with env {}
12:12:03.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.698146 11571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } has no permanent_uuid. Determining permanent_uuid...
12:12:03.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.718488 11571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } has no permanent_uuid. Determining permanent_uuid...
12:12:03.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.732039 11571 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } has no permanent_uuid. Determining permanent_uuid...
12:12:03.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.734676 11520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:03.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.739008 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:03.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.788502 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 1
12:12:03.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.792968 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:03.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.861368 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 2
12:12:03.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.865707 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:03.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:03.957075 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 3
12:12:03.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.961580 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:03.999954 11573 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:04.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.000524 11573 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.001003 11573 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.035650 11573 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.035916 11573 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.036108 11573 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.036290 11573 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.036490 11573 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:04.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.036635 11573 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45109/jwks.json
12:12:04.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.037990 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } attempt: 7
12:12:04.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.049726 11496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } has no permanent_uuid. Determining permanent_uuid...
12:12:04.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.055445 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.076946 11573 master_runner.cc:387] Master server non-default flags:
12:12:04.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:04.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:04.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.60:33275
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45109/jwks.json
12:12:04.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data/info.pb
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.60
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:04.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/logs
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.078605 11573 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.080863 11573 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:04.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.091298 11585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:04.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.105005 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 4
12:12:04.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.111784 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.113857 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 1
12:12:04.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.120486 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.201937 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 2
12:12:04.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.209059 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.294540 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 3
12:12:04.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.301469 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.411255 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 5
12:12:04.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.419159 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.441929 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 4
12:12:04.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.449038 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.732512 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 5
12:12:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.739349 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:04.966629 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 6
12:12:04.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.992903 11571 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:05.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.291795 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 6
12:12:05.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.317524 11496 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.38.60:33275: Network error: Client connection negotiation failed: client connection to 127.11.38.60:33275: connect: Connection refused (error 111)
12:12:05.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.494374 11584 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11573
12:12:05.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.541277 11573 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.449s	user 0.597s	sys 0.847s
12:12:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.541615 11573 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.450s	user 0.597s	sys 0.847s
12:12:05.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:04.092535 11586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:05.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.543594 11588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:05.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.546197 11587 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1451 milliseconds
12:12:05.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.546252 11573 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:05.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.547394 11573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:05.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.550081 11573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:05.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.551426 11573 hybrid_clock.cc:648] HybridClock initialized: now 1783512725551384 us; error 44 us; skew 500 ppm
12:12:05.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.552148 11573 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:05.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.557744 11573 webserver.cc:533] Webserver started at http://127.11.38.60:45577/ using document root <none> and password file <none>
12:12:05.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.558566 11573 fs_manager.cc:362] Metadata directory not provided
12:12:05.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.558743 11573 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:05.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.559103 11573 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:05.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.563112 11573 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data/instance:
12:12:05.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c1f7f2e91bc546b598ba89ec942057ae"
12:12:05.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:05 on dist-test-slave-vcgh"
12:12:05.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.564103 11573 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal/instance:
12:12:05.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c1f7f2e91bc546b598ba89ec942057ae"
12:12:05.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:05 on dist-test-slave-vcgh"
12:12:05.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.570813 11573 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
12:12:05.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.575971 11599 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:05.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.577065 11573 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
12:12:05.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.577342 11573 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal
12:12:05.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c1f7f2e91bc546b598ba89ec942057ae"
12:12:05.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:05 on dist-test-slave-vcgh"
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.577632 11573 fs_report.cc:389] FS layout report
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data/data
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:05.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:05.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.679338 11573 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:05.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.680966 11573 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:05.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.681453 11573 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:05.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.752442 11573 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.60:33275
12:12:05.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.752602 11650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.60:33275 every 8 connection(s)
12:12:05.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.755488 11573 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/data/info.pb
12:12:05.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.761559 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:05.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.763373 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 11573
12:12:05.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.763815 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/master-2/wal/instance
12:12:05.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.773712 11651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } has no permanent_uuid. Determining permanent_uuid...
12:12:05.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.817415 11651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } has no permanent_uuid. Determining permanent_uuid...
12:12:05.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.828965 11651 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } has no permanent_uuid. Determining permanent_uuid...
12:12:05.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.844170 11651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: Bootstrap starting.
12:12:05.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.849828 11651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: Neither blocks nor log segments found. Creating new log.
12:12:05.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.852134 11651 log.cc:826] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: Log is configured to *not* fsync() on all Append() calls
12:12:05.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.856149 11651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: No bootstrap required, opened a new log
12:12:05.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.874184 11651 raft_consensus.cc:359] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:05.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.874804 11651 raft_consensus.cc:385] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:05.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.875057 11651 raft_consensus.cc:740] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1f7f2e91bc546b598ba89ec942057ae, State: Initialized, Role: FOLLOWER
12:12:05.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.875895 11651 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:05.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.878626 11660 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:05.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.879694 11660 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: This master's current role is: FOLLOWER
12:12:05.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.880321 11651 sys_catalog.cc:565] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: configured and running, proceeding with master startup.
12:12:05.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.903110 11671 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:05.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.903983 11671 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:05.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.900326 11573 master_runner.cc:187] Error getting master registration for 127.11.38.62:34839: OK, instance_id { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" instance_seqno: 1783512721638814 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:05.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.922063 11573 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:05.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:05.937964 11605 tablet.cc:2406] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:06.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.053331 11571 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 7
12:12:06.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.070174 11571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: Bootstrap starting.
12:12:06.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.075439 11571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: Neither blocks nor log segments found. Creating new log.
12:12:06.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.077384 11571 log.cc:826] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: Log is configured to *not* fsync() on all Append() calls
12:12:06.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.083223 11571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: No bootstrap required, opened a new log
12:12:06.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.100172 11571 raft_consensus.cc:359] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.100804 11571 raft_consensus.cc:385] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:06.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.101006 11571 raft_consensus.cc:740] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 534e48c5688b4ca6ae635d4f4e5574c7, State: Initialized, Role: FOLLOWER
12:12:06.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.101801 11571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.106249 11675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.107311 11675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.111312 11571 sys_catalog.cc:565] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: configured and running, proceeding with master startup.
12:12:06.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.116895 11525 tablet.cc:2406] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:06.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.118160 11675 raft_consensus.cc:493] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:06.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.118639 11675 raft_consensus.cc:515] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.124498 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f7f2e91bc546b598ba89ec942057ae" is_pre_election: true
12:12:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.125393 11626 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 534e48c5688b4ca6ae635d4f4e5574c7 in term 0.
12:12:06.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.127259 11520 leader_election.cc:304] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 534e48c5688b4ca6ae635d4f4e5574c7, c1f7f2e91bc546b598ba89ec942057ae; no voters: 
12:12:06.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.129303 11675 leader_election.cc:290] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af3865196ab543a48ce7481dd167f4a4 (127.11.38.62:34839), c1f7f2e91bc546b598ba89ec942057ae (127.11.38.60:33275)
12:12:06.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.136880 11675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:06.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.138706 11675 raft_consensus.cc:493] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:06.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.139567 11675 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 0 FOLLOWER]: Advancing to term 1
12:12:06.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.148644 11675 raft_consensus.cc:515] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.150631 11675 leader_election.cc:290] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [CANDIDATE]: Term 1 election: Requested vote from peers af3865196ab543a48ce7481dd167f4a4 (127.11.38.62:34839), c1f7f2e91bc546b598ba89ec942057ae (127.11.38.60:33275)
12:12:06.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.152144 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1f7f2e91bc546b598ba89ec942057ae"
12:12:06.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.152709 11626 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 0 FOLLOWER]: Advancing to term 1
12:12:06.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.162475 11626 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 534e48c5688b4ca6ae635d4f4e5574c7 in term 1.
12:12:06.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.163726 11520 leader_election.cc:304] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 534e48c5688b4ca6ae635d4f4e5574c7, c1f7f2e91bc546b598ba89ec942057ae; no voters: 
12:12:06.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.164500 11675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 1 FOLLOWER]: Leader election won for term 1
12:12:06.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.164947 11675 raft_consensus.cc:697] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [term 1 LEADER]: Becoming Leader. State: Replica: 534e48c5688b4ca6ae635d4f4e5574c7, State: Running, Role: LEADER
12:12:06.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.165848 11675 consensus_queue.cc:237] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.178510 11679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 534e48c5688b4ca6ae635d4f4e5574c7. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.179260 11679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: This master's current role is: LEADER
12:12:06.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.220139 11687 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:06.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.220997 11687 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:06.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.221769 11689 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:12:06.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.172183 11498 master_runner.cc:187] Error getting master registration for 127.11.38.62:34839: OK, instance_id { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" instance_seqno: 1783512721638814 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:06.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.222452 11498 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:06.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.229319 11689 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:12:06.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.251600 11626 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [term 1 FOLLOWER]: Refusing update from remote peer 534e48c5688b4ca6ae635d4f4e5574c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:06.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.253451 11675 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.279951 11660 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 534e48c5688b4ca6ae635d4f4e5574c7. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.280635 11660 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.296449 11692 mvcc.cc:204] Tried to move back new op lower bound from 7305268126705332224 to 7305268126385152000. Current Snapshot: MvccSnapshot[applied={T|T < 7305268126705332224}]
12:12:06.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.302110 11675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.302824 11675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: This master's current role is: LEADER
12:12:06.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.307325 11660 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.308008 11660 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.319087 11689 catalog_manager.cc:1383] Generated new cluster ID: 329763b1585a4e35b620f7e810332537
12:12:06.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.319397 11689 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:12:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.350965 11496 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } attempt: 7
12:12:06.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.368451 11689 catalog_manager.cc:1406] Generated new certificate authority record
12:12:06.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.372242 11689 catalog_manager.cc:1540] Loading token signing keys...
12:12:06.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.411588 11496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: Bootstrap starting.
12:12:06.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.411192 11689 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7: Generated new TSK 0
12:12:06.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.414299 11689 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:12:06.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.418610 11496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: Neither blocks nor log segments found. Creating new log.
12:12:06.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.433108 11496 log.cc:826] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: Log is configured to *not* fsync() on all Append() calls
12:12:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.440121 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/logs
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data/info.pb
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.1:0
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.1
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.1
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:06.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.441527 11496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: No bootstrap required, opened a new log
12:12:06.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.554802 11496 raft_consensus.cc:359] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.558696 11496 raft_consensus.cc:385] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:06.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.559383 11496 raft_consensus.cc:740] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3865196ab543a48ce7481dd167f4a4, State: Initialized, Role: FOLLOWER
12:12:06.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.560724 11496 consensus_queue.cc:260] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } }
12:12:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.571411 11699 sys_catalog.cc:455] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.575628 11699 sys_catalog.cc:458] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.576102 11471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3865196ab543a48ce7481dd167f4a4" is_pre_election: true
12:12:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.576886 11471 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 534e48c5688b4ca6ae635d4f4e5574c7 in term 0.
12:12:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.578176 11469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 0 FOLLOWER]: Advancing to term 1
12:12:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.575448 11470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3865196ab543a48ce7481dd167f4a4"
12:12:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.575276 11496 sys_catalog.cc:565] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: configured and running, proceeding with master startup.
12:12:06.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.585099 11469 raft_consensus.cc:1275] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [term 1 FOLLOWER]: Refusing update from remote peer 534e48c5688b4ca6ae635d4f4e5574c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:06.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.586910 11675 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:06.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.600414 11450 tablet.cc:2406] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:06.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.639011 11699 sys_catalog.cc:455] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 534e48c5688b4ca6ae635d4f4e5574c7. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.640185 11699 sys_catalog.cc:458] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.639235 11704 sys_catalog.cc:455] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.640990 11704 sys_catalog.cc:458] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:06.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.723629 11716 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:12:06.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.913193 11671 catalog_manager.cc:1295] Loaded cluster ID: 329763b1585a4e35b620f7e810332537
12:12:06.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.913964 11671 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: loading cluster ID for follower catalog manager: success
12:12:06.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.922051 11671 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: acquiring CA information for follower catalog manager: success
12:12:06.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.927731 11671 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c1f7f2e91bc546b598ba89ec942057ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:07.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.025389 11698 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:07.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.026036 11698 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:07.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.026748 11698 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:07.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.083789 11698 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.085152 11698 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.38.1
12:12:07.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.149107 11698 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:07.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.1:0
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:07.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data/info.pb
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.1
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:07.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:07.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.1
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/logs
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:07.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:07.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.150835 11698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:07.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.152992 11698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:07.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.169631 11722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:07.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.235529 11725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af3865196ab543a48ce7481dd167f4a4" member_type: VOTER last_known_addr { host: "127.11.38.62" port: 34839 } } peers { permanent_uuid: "534e48c5688b4ca6ae635d4f4e5574c7" member_type: VOTER last_known_addr { host: "127.11.38.61" port: 36393 } } peers { permanent_uuid: "c1f7f2e91bc546b598ba89ec942057ae" member_type: VOTER last_known_addr { host: "127.11.38.60" port: 33275 } } }
12:12:07.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.237283 11725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534e48c5688b4ca6ae635d4f4e5574c7 [sys.catalog]: This master's current role is: LEADER
12:12:07.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.757153 11716 catalog_manager.cc:1295] Loaded cluster ID: 329763b1585a4e35b620f7e810332537
12:12:07.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.760824 11716 catalog_manager.cc:1588] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: loading cluster ID for follower catalog manager: success
12:12:07.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.805159 11716 catalog_manager.cc:1610] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: acquiring CA information for follower catalog manager: success
12:12:07.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:07.811780 11716 catalog_manager.cc:1638] T 00000000000000000000000000000000 P af3865196ab543a48ce7481dd167f4a4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:08.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.571204 11721 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11698
12:12:08.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.687443 11698 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.517s	user 0.601s	sys 0.896s
12:12:08.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.693836 11698 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.524s	user 0.601s	sys 0.897s
12:12:08.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.171227 11723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:08.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.704347 11731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:08.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.704358 11698 server_base.cc:1061] running on GCE node
12:12:08.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.706694 11698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:08.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.716639 11698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:08.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.718451 11698 hybrid_clock.cc:648] HybridClock initialized: now 1783512728718344 us; error 116 us; skew 500 ppm
12:12:08.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.719785 11698 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.738619 11698 webserver.cc:533] Webserver started at http://127.11.38.1:33507/ using document root <none> and password file <none>
12:12:08.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.740296 11698 fs_manager.cc:362] Metadata directory not provided
12:12:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.740933 11698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.741724 11698 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.750388 11698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data/instance:
12:12:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fa64cca4754485089da2caa96ce2824"
12:12:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-vcgh"
12:12:08.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.752525 11698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal/instance:
12:12:08.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fa64cca4754485089da2caa96ce2824"
12:12:08.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-vcgh"
12:12:08.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.780579 11698 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.022s	sys 0.000s
12:12:08.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.809616 11736 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:08.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.812615 11698 fs_manager.cc:730] Time spent opening block manager: real 0.027s	user 0.014s	sys 0.010s
12:12:08.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.813546 11698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal
12:12:08.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1fa64cca4754485089da2caa96ce2824"
12:12:08.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-vcgh"
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.814316 11698 fs_report.cc:389] FS layout report
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data/data
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:08.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:08.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.920307 11698 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:08.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.922712 11698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:08.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.923669 11698 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:08.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.937381 11698 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:08.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.951368 11698 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:08.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.952049 11698 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
12:12:08.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.952838 11698 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:08.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.953267 11698 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.370239 11698 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.1:37833
12:12:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.370349 11848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.1:37833 every 8 connection(s)
12:12:09.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.372859 11698 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/data/info.pb
12:12:09.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.378865 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 11698
12:12:09.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.379386 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-0/wal/instance
12:12:09.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.388871 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:09.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:09.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/logs
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data/info.pb
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:09.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.2:0
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.2
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.2
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.430212 11849 heartbeater.cc:344] Connected to a master server at 127.11.38.60:33275
12:12:09.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.431243 11849 heartbeater.cc:461] Registering TS with master...
12:12:09.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.432984 11849 heartbeater.cc:507] Master 127.11.38.60:33275 requested a full tablet report, sending...
12:12:09.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.436772 11616 ts_manager.cc:194] Registered new tserver with Master: 1fa64cca4754485089da2caa96ce2824 (127.11.38.1:37833)
12:12:09.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.438578 11850 heartbeater.cc:344] Connected to a master server at 127.11.38.61:36393
12:12:09.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.438879 11850 heartbeater.cc:461] Registering TS with master...
12:12:09.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.439625 11850 heartbeater.cc:507] Master 127.11.38.61:36393 requested a full tablet report, sending...
12:12:09.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.442147 11536 ts_manager.cc:194] Registered new tserver with Master: 1fa64cca4754485089da2caa96ce2824 (127.11.38.1:37833)
12:12:09.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.444868 11536 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.38.1:34029
12:12:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.452402 11851 heartbeater.cc:344] Connected to a master server at 127.11.38.62:34839
12:12:09.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.452770 11851 heartbeater.cc:461] Registering TS with master...
12:12:09.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.453389 11851 heartbeater.cc:507] Master 127.11.38.62:34839 requested a full tablet report, sending...
12:12:09.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.455667 11461 ts_manager.cc:194] Registered new tserver with Master: 1fa64cca4754485089da2caa96ce2824 (127.11.38.1:37833)
12:12:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.747138 11856 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:09.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.747640 11856 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:09.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.748201 11856 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:09.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.781000 11856 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:09.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.781975 11856 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.38.2
12:12:09.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.818102 11856 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:09.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:09.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:09.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:09.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.2:0
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data/info.pb
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.2
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.2
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/logs
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:09.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.819669 11856 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:09.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.821780 11856 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:09.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.835616 11865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:10.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.448942 11850 heartbeater.cc:499] Master 127.11.38.61:36393 was elected leader, sending a full tablet report...
12:12:11.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.837577 11866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:11.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.237377 11864 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11856
12:12:11.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.483531 11856 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.647s	user 0.634s	sys 0.969s
12:12:11.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.485337 11856 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.649s	user 0.634s	sys 0.969s
12:12:11.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.485625 11868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:11.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.488839 11867 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1647 milliseconds
12:12:11.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.488916 11856 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:11.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.489954 11856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:11.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.491879 11856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:11.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.493206 11856 hybrid_clock.cc:648] HybridClock initialized: now 1783512731493163 us; error 40 us; skew 500 ppm
12:12:11.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.494127 11856 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:11.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.499974 11856 webserver.cc:533] Webserver started at http://127.11.38.2:33239/ using document root <none> and password file <none>
12:12:11.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.500855 11856 fs_manager.cc:362] Metadata directory not provided
12:12:11.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.501044 11856 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:11.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.501556 11856 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:11.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.505808 11856 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data/instance:
12:12:11.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6bfab9f4b9384a25a61717f3e0e74b1b"
12:12:11.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:11 on dist-test-slave-vcgh"
12:12:11.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.506793 11856 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal/instance:
12:12:11.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6bfab9f4b9384a25a61717f3e0e74b1b"
12:12:11.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:11 on dist-test-slave-vcgh"
12:12:11.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.513347 11856 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.002s
12:12:11.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.519037 11877 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:11.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.520018 11856 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
12:12:11.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.520287 11856 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal
12:12:11.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6bfab9f4b9384a25a61717f3e0e74b1b"
12:12:11.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:11 on dist-test-slave-vcgh"
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.520562 11856 fs_report.cc:389] FS layout report
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data/data
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:11.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:11.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.594842 11856 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.596240 11856 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.596662 11856 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:11.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.599169 11856 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.603097 11856 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.603281 11856 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.603459 11856 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:11.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.603590 11856 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:11.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.738476 11856 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.2:44311
12:12:11.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.738639 11989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.2:44311 every 8 connection(s)
12:12:11.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.741117 11856 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/data/info.pb
12:12:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.745182 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 11856
12:12:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.745816 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-1/wal/instance
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.767824 11416 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/logs
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data/info.pb
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.3:0
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.3
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.3
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:11.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.802405 11990 heartbeater.cc:344] Connected to a master server at 127.11.38.60:33275
12:12:11.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.802910 11990 heartbeater.cc:461] Registering TS with master...
12:12:11.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.804168 11990 heartbeater.cc:507] Master 127.11.38.60:33275 requested a full tablet report, sending...
12:12:11.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.806887 11991 heartbeater.cc:344] Connected to a master server at 127.11.38.61:36393
12:12:11.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.807200 11991 heartbeater.cc:461] Registering TS with master...
12:12:11.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.808033 11991 heartbeater.cc:507] Master 127.11.38.61:36393 requested a full tablet report, sending...
12:12:11.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.808718 11616 ts_manager.cc:194] Registered new tserver with Master: 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2:44311)
12:12:11.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.810225 11536 ts_manager.cc:194] Registered new tserver with Master: 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2:44311)
12:12:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.811794 11992 heartbeater.cc:344] Connected to a master server at 127.11.38.62:34839
12:12:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.811898 11536 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.38.2:47241
12:12:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.812108 11992 heartbeater.cc:461] Registering TS with master...
12:12:11.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.812819 11992 heartbeater.cc:507] Master 127.11.38.62:34839 requested a full tablet report, sending...
12:12:11.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.815402 11461 ts_manager.cc:194] Registered new tserver with Master: 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2:44311)
12:12:12.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.087641 12000 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:12.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.088202 12000 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:12.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.088637 12000 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:12.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.120464 12000 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:12.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.121268 12000 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.38.3
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.156718 12000 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.38.20:40455
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.38.3:0
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data/info.pb
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.38.3
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.38.62:34839,127.11.38.61:36393,127.11.38.60:33275
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.38.3
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/logs
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:12.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:12.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:12.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:12.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.157987 12000 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:12.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.159477 12000 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.170728 12007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:12.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.815433 11991 heartbeater.cc:499] Master 127.11.38.61:36393 was elected leader, sending a full tablet report...
12:12:13.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.171868 12008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.573748 12006 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 12000
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.658463 12006 kernel_stack_watchdog.cc:198] Thread 12000 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:13.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.662429 12000 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.491s	user 0.634s	sys 0.849s
12:12:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.662678 12009 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1486 milliseconds
12:12:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.663172 12000 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.492s	user 0.634s	sys 0.849s
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.664147 12010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.664211 12000 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.665403 12000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:13.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.667500 12000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.668834 12000 hybrid_clock.cc:648] HybridClock initialized: now 1783512733668791 us; error 35 us; skew 500 ppm
12:12:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.669624 12000 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:13.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.675819 12000 webserver.cc:533] Webserver started at http://127.11.38.3:37593/ using document root <none> and password file <none>
12:12:13.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.676977 12000 fs_manager.cc:362] Metadata directory not provided
12:12:13.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.677227 12000 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:13.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.677717 12000 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:13.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.683517 12000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data/instance:
12:12:13.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e"
12:12:13.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:13 on dist-test-slave-vcgh"
12:12:13.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.684921 12000 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal/instance:
12:12:13.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e"
12:12:13.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:13 on dist-test-slave-vcgh"
12:12:13.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.694017 12000 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.006s
12:12:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.700805 12019 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.702013 12000 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
12:12:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.702387 12000 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal
12:12:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e"
12:12:13.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:13 on dist-test-slave-vcgh"
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.702788 12000 fs_report.cc:389] FS layout report
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data/data
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:13.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:13.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.755929 12000 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:13.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.757500 12000 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:13.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.757889 12000 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:13.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.760426 12000 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:13.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.764532 12000 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:13.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.764753 12000 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
12:12:13.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.765053 12000 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:13.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.765280 12000 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:13.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.892915 12000 rpc_server.cc:307] RPC server started. Bound to: 127.11.38.3:39999
12:12:13.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.893018 12131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.38.3:39999 every 8 connection(s)
12:12:13.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.895666 12000 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/data/info.pb
12:12:13.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.904472 11416 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12000
12:12:13.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.904964 11416 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2885735061199625769/ts-2/wal/instance
12:12:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.938519 12132 heartbeater.cc:344] Connected to a master server at 127.11.38.60:33275
12:12:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.939039 12132 heartbeater.cc:461] Registering TS with master...
12:12:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.940366 12132 heartbeater.cc:507] Master 127.11.38.60:33275 requested a full tablet report, sending...
12:12:13.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.943596 12133 heartbeater.cc:344] Connected to a master server at 127.11.38.61:36393
12:12:13.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.943894 12133 heartbeater.cc:461] Registering TS with master...
12:12:13.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.943780 11615 ts_manager.cc:194] Registered new tserver with Master: 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.944754 12133 heartbeater.cc:507] Master 127.11.38.61:36393 requested a full tablet report, sending...
12:12:13.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.947607 11536 ts_manager.cc:194] Registered new tserver with Master: 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:13.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.948338 12134 heartbeater.cc:344] Connected to a master server at 127.11.38.62:34839
12:12:13.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.948678 12134 heartbeater.cc:461] Registering TS with master...
12:12:13.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.949347 11536 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.38.3:48829
12:12:13.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.949577 12134 heartbeater.cc:507] Master 127.11.38.62:34839 requested a full tablet report, sending...
12:12:13.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.951926 11461 ts_manager.cc:194] Registered new tserver with Master: 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:13.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.972394 11416 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:12:13.987 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:13.988 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:12:13.998 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.38.62"
      port: 34839
    }
    bound_http_address {
      host: "127.11.38.62"
      port: 44241
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.38.61"
      port: 36393
    }
    bound_http_address {
      host: "127.11.38.61"
      port: 42019
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.38.60"
      port: 33275
    }
    bound_http_address {
      host: "127.11.38.60"
      port: 45577
    }
  }
}

12:12:14.003 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:12:14.006 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.38.1"
      port: 37833
    }
    bound_http_address {
      host: "127.11.38.1"
      port: 33507
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.38.2"
      port: 44311
    }
    bound_http_address {
      host: "127.11.38.2"
      port: 33239
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.38.3"
      port: 39999
    }
    bound_http_address {
      host: "127.11.38.3"
      port: 37593
    }
  }
}

12:12:14.006 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:12:14.019 [DEBUG - main] (InternalLoggerFactory.java:63) Using SLF4J as the default logging framework
12:12:14.023 [DEBUG - main] (ResourceLeakDetector.java:129) -Dorg.apache.kudu.shaded.io.netty.leakDetection.level: simple
12:12:14.023 [DEBUG - main] (ResourceLeakDetector.java:130) -Dorg.apache.kudu.shaded.io.netty.leakDetection.targetRecords: 4
12:12:14.028 [DEBUG - main] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@403f0a22
12:12:14.050 [DEBUG - main] (PlatformDependent0.java:1138) Java version: 17
12:12:14.051 [DEBUG - main] (PlatformDependent0.java:616) -Dio.netty.noUnsafe: false
12:12:14.051 [DEBUG - main] (PlatformDependent0.java:559) Thread.isVirtual() is not available: 
12:12:14.051 [DEBUG - main] (PlatformDependent0.java:572) java.lang.BaseVirtualThread is not available: 
12:12:14.052 [DEBUG - main] (PlatformDependent0.java:145) sun.misc.Unsafe.theUnsafe: available
12:12:14.053 [DEBUG - main] (PlatformDependent0.java:208) sun.misc.Unsafe base methods: all available
12:12:14.053 [DEBUG - main] (PlatformDependent0.java:240) sun.misc.Unsafe.storeFence: available
12:12:14.054 [DEBUG - main] (PlatformDependent0.java:283) java.nio.Buffer.address: available
12:12:14.054 [DEBUG - main] (PlatformDependent0.java:369) direct buffer constructor: unavailable: Reflective setAccessible(true) disabled
12:12:14.054 [DEBUG - main] (PlatformDependent0.java:447) java.nio.Bits.unaligned: available, true
12:12:14.056 [DEBUG - main] (PlatformDependent0.java:515) jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable: class org.apache.kudu.shaded.io.netty.util.internal.PlatformDependent0$7 cannot access class jdk.internal.misc.Unsafe (in module java.base) because module java.base does not export jdk.internal.misc to unnamed module @589b3632
12:12:14.057 [DEBUG - main] (PlatformDependent0.java:545) java.nio.DirectByteBuffer.<init>(long, {int,long}): unavailable
12:12:14.057 [DEBUG - main] (PlatformDependent.java:1214) sun.misc.Unsafe: available
12:12:14.057 [DEBUG - main] (PlatformDependent.java:1360) -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
12:12:14.057 [DEBUG - main] (PlatformDependent.java:1439) -Dio.netty.bitMode: 64 (sun.arch.data.model)
12:12:14.058 [DEBUG - main] (PlatformDependent.java:181) -Dio.netty.maxDirectMemory: -1 bytes
12:12:14.058 [DEBUG - main] (PlatformDependent.java:188) -Dio.netty.uninitializedArrayAllocationThreshold: -1
12:12:14.059 [DEBUG - main] (CleanerJava9.java:71) java.nio.ByteBuffer.cleaner(): available
12:12:14.059 [DEBUG - main] (PlatformDependent.java:209) -Dio.netty.noPreferDirect: false
12:12:14.068 [DEBUG - main] (PlatformDependent.java:1048) org.jctools-core.MpscChunkedArrayQueue: available
12:12:14.105 [DEBUG - main] (MultithreadEventLoopGroup.java:44) -Dio.netty.eventLoopThreads: 8
12:12:14.114 [DEBUG - main] (GlobalEventExecutor.java:54) -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1
12:12:14.118 [DEBUG - main] (InternalThreadLocalMap.java:100) -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
12:12:14.118 [DEBUG - main] (InternalThreadLocalMap.java:101) -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
12:12:14.125 [DEBUG - main] (NioEventLoop.java:110) -Dio.netty.noKeySetOptimization: false
12:12:14.125 [DEBUG - main] (NioEventLoop.java:111) -Dio.netty.selectorAutoRebuildThreshold: 512
12:12:14.177 [DEBUG - main] (PooledByteBufAllocator.java:161) -Dio.netty.allocator.numHeapArenas: 8
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:162) -Dio.netty.allocator.numDirectArenas: 8
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:164) -Dio.netty.allocator.pageSize: 8192
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:169) -Dio.netty.allocator.maxOrder: 9
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:173) -Dio.netty.allocator.chunkSize: 4194304
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:174) -Dio.netty.allocator.smallCacheSize: 256
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:175) -Dio.netty.allocator.normalCacheSize: 64
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:176) -Dio.netty.allocator.maxCachedBufferCapacity: 32768
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:177) -Dio.netty.allocator.cacheTrimInterval: 8192
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:178) -Dio.netty.allocator.cacheTrimIntervalMillis: 0
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:179) -Dio.netty.allocator.useCacheForAllThreads: false
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:180) -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
12:12:14.178 [DEBUG - main] (PooledByteBufAllocator.java:182) -Dio.netty.allocator.disableCacheFinalizersForFastThreadLocalThreads: false
12:12:14.194 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
12:12:14.254 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:14.348 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:12:14.348 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:12:14.349 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:12:14.349 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:12:14.353 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:12:14.683 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:14.683 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:12:14.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.687932 12144 mini_oidc.cc:150] Starting JWKS server
12:12:14.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.691640 12144 webserver.cc:533] Webserver started at http://127.0.0.1:33939/ using document root <none> and password file <none>
12:12:14.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.692162 12144 mini_oidc.cc:186] Starting OIDC Discovery server
12:12:14.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.694118 12144 webserver.cc:533] Webserver started at http://127.0.0.1:34263/ using document root <none> and password file <none>
12:12:14.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:12:14.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:14Z Disabled control of system clock
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.751677 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/logs
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data/info.pb
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:14.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.62:34269
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.62
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:14.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json with env {}
12:12:14.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.952802 12133 heartbeater.cc:499] Master 127.11.38.61:36393 was elected leader, sending a full tablet report...
12:12:15.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.043998 12157 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:15.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.044528 12157 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:15.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.045076 12157 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.076678 12157 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.076984 12157 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.077174 12157 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:15.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.077450 12157 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:15.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.077761 12157 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:15.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.078023 12157 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33939/jwks.json
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:15.113976 12157 master_runner.cc:387] Master server non-default flags:
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.62:34269
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:15.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data/info.pb
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.62
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/logs
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:15.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:15.115293 12157 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:15.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:15.117393 12157 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:16.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.129595 12164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.129630 12163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.402937 12166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.405332 12157 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.276s	user 0.503s	sys 0.742s
12:12:16.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.405665 12157 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.277s	user 0.504s	sys 0.742s
12:12:16.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.407202 12165 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1272 milliseconds
12:12:16.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.407243 12157 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:16.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.408849 12157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:16.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.411871 12157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.413889 12157 hybrid_clock.cc:648] HybridClock initialized: now 1783512736413858 us; error 33 us; skew 500 ppm
12:12:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.414634 12157 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.421541 12157 webserver.cc:533] Webserver started at http://127.11.220.62:34641/ using document root <none> and password file <none>
12:12:16.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.422451 12157 fs_manager.cc:362] Metadata directory not provided
12:12:16.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.422624 12157 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:16.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.423070 12157 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:16.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.427227 12157 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data/instance:
12:12:16.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8bff7c34a401499aa4ae13afca98d84e"
12:12:16.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-vcgh"
12:12:16.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.428228 12157 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal/instance:
12:12:16.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8bff7c34a401499aa4ae13afca98d84e"
12:12:16.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-vcgh"
12:12:16.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.435762 12157 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
12:12:16.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.441708 12173 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:16.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.442862 12157 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:12:16.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.443190 12157 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal
12:12:16.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8bff7c34a401499aa4ae13afca98d84e"
12:12:16.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-vcgh"
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.443527 12157 fs_report.cc:389] FS layout report
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data/data
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:16.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.535493 12157 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.537102 12157 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:16.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.537626 12157 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:16.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.603488 12157 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.62:34269
12:12:16.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.603577 12224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.62:34269 every 8 connection(s)
12:12:16.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.606465 12157 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/data/info.pb
12:12:16.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.611991 12225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:16.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.615320 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12157
12:12:16.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.615703 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-0/wal/instance
12:12:16.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.619637 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/logs
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data/info.pb
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.61:39401
12:12:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.61
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json with env {}
12:12:16.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.623919 12225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } has no permanent_uuid. Determining permanent_uuid...
12:12:16.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.650173 12225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } has no permanent_uuid. Determining permanent_uuid...
12:12:16.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.652350 12176 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:16.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.656240 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.705729 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 1
12:12:16.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.710009 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:16.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.778376 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 2
12:12:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.782307 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:16.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.873670 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 3
12:12:16.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.878278 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.930327 12227 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.930840 12227 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.931270 12227 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.966957 12227 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.967231 12227 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.967422 12227 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.967617 12227 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:16.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.967806 12227 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:16.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.967960 12227 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33939/jwks.json
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.014055 12227 master_runner.cc:387] Master server non-default flags:
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.61:39401
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data/info.pb
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.61
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/logs
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:17.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.015673 12227 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:17.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.017828 12227 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:17.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.021728 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 4
12:12:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.029752 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:17.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.033150 12237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:17.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.329262 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 5
12:12:17.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.336745 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:17.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.884203 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 6
12:12:17.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.919787 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.61:39401: Network error: Client connection negotiation failed: client connection to 127.11.220.61:39401: connect: Connection refused (error 111)
12:12:18.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.026652 11567 debug-util.cc:398] Leaking SignalData structure 0x7b080008aa80 after lost signal to thread 11502
12:12:18.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.027415 11567 debug-util.cc:398] Leaking SignalData structure 0x7b0800094d80 after lost signal to thread 11570
12:12:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.433740 12236 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 12227
12:12:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.515667 12227 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.481s	user 0.620s	sys 0.858s
12:12:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.516058 12227 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.482s	user 0.620s	sys 0.858s
12:12:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.034690 12238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:18.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.517347 12239 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1483 milliseconds
12:12:18.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.518694 12240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:18.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.518687 12227 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:18.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.521912 12227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:18.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.524622 12227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:18.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.526014 12227 hybrid_clock.cc:648] HybridClock initialized: now 1783512738525981 us; error 37 us; skew 500 ppm
12:12:18.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.526762 12227 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:18.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.532837 12227 webserver.cc:533] Webserver started at http://127.11.220.61:39255/ using document root <none> and password file <none>
12:12:18.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.533772 12227 fs_manager.cc:362] Metadata directory not provided
12:12:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.533953 12227 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:18.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.534315 12227 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:18.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.538364 12227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data/instance:
12:12:18.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "129656c699a04c5f8fcce84a60c0f07d"
12:12:18.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-vcgh"
12:12:18.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.539327 12227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal/instance:
12:12:18.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "129656c699a04c5f8fcce84a60c0f07d"
12:12:18.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-vcgh"
12:12:18.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.546449 12227 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.002s
12:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.552618 12249 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:18.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.553695 12227 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.553996 12227 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "129656c699a04c5f8fcce84a60c0f07d"
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-vcgh"
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.554276 12227 fs_report.cc:389] FS layout report
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data/data
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:18.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.610206 12227 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.612071 12227 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.612673 12227 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:18.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.697944 12227 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.61:39401
12:12:18.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.698015 12300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.61:39401 every 8 connection(s)
12:12:18.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.700574 12227 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/data/info.pb
12:12:18.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.707248 12301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.710812 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12227
12:12:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.711164 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-1/wal/instance
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.713267 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/logs
12:12:18.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data/info.pb
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.60:40605
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.60
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:18.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json with env {}
12:12:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.722013 12301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } has no permanent_uuid. Determining permanent_uuid...
12:12:18.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.766593 12301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } has no permanent_uuid. Determining permanent_uuid...
12:12:18.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.797569 12301 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } has no permanent_uuid. Determining permanent_uuid...
12:12:18.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.800424 12253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:18.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.808300 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:18.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.857820 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 1
12:12:18.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.862596 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.931008 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 2
12:12:18.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.935758 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:18.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.980258 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } attempt: 7
12:12:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.993963 12225 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } has no permanent_uuid. Determining permanent_uuid...
12:12:19.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.003366 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.027187 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 3
12:12:19.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.031802 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.054442 12303 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:19.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.054972 12303 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:19.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.055421 12303 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:19.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.061784 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 1
12:12:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.066846 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.090260 12303 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:19.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.090529 12303 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:19.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.090719 12303 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:19.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.090926 12303 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:19.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.091115 12303 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:19.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.091259 12303 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33939/jwks.json
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.127942 12303 master_runner.cc:387] Master server non-default flags:
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.60:40605
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33939/jwks.json
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data/info.pb
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.60
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/logs
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:19.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.129197 12303 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:19.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.131156 12303 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:19.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.142236 12315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:19.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.148241 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 2
12:12:19.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.155650 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.175313 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 4
12:12:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.182742 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.241048 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 3
12:12:19.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.247181 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.387585 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 4
12:12:19.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.393718 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.482194 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 5
12:12:19.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.490353 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:19.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.677258 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 5
12:12:19.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.683444 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:20.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.037784 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 6
12:12:20.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.077322 12301 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:20.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.235862 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 6
12:12:20.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.279970 12225 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.220.60:40605: Network error: Client connection negotiation failed: client connection to 127.11.220.60:40605: connect: Connection refused (error 111)
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.544075 12314 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 12303
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.790512 12314 kernel_stack_watchdog.cc:198] Thread 12303 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.791850 12303 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.648s	user 0.574s	sys 1.012s
12:12:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.792423 12303 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.649s	user 0.575s	sys 1.012s
12:12:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.792659 12317 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1647 milliseconds
12:12:20.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.143362 12316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:20.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.794245 12303 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:20.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.794279 12318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:20.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.797857 12303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:20.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.800228 12303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:20.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.801563 12303 hybrid_clock.cc:648] HybridClock initialized: now 1783512740801531 us; error 36 us; skew 500 ppm
12:12:20.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.802369 12303 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:20.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.808079 12303 webserver.cc:533] Webserver started at http://127.11.220.60:36765/ using document root <none> and password file <none>
12:12:20.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.809055 12303 fs_manager.cc:362] Metadata directory not provided
12:12:20.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.809262 12303 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:20.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.809734 12303 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:20.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.813884 12303 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data/instance:
12:12:20.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1a62e5374c04b78b3ff6ede5074849e"
12:12:20.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-vcgh"
12:12:20.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.814992 12303 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal/instance:
12:12:20.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1a62e5374c04b78b3ff6ede5074849e"
12:12:20.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-vcgh"
12:12:20.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.822321 12303 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
12:12:20.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.827762 12332 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.828851 12303 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.829123 12303 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1a62e5374c04b78b3ff6ede5074849e"
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-vcgh"
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.829423 12303 fs_report.cc:389] FS layout report
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data/data
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:20.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.892729 12303 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:20.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.894105 12303 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:20.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.894604 12303 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:20.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.962826 12303 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.60:40605
12:12:20.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.962898 12383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.60:40605 every 8 connection(s)
12:12:20.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.965597 12303 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/data/info.pb
12:12:20.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.970745 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12303
12:12:20.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.971102 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/master-2/wal/instance
12:12:20.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.971923 12384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:20.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.988413 12384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } has no permanent_uuid. Determining permanent_uuid...
12:12:21.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.010780 12384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } has no permanent_uuid. Determining permanent_uuid...
12:12:21.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.020118 12384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } has no permanent_uuid. Determining permanent_uuid...
12:12:21.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.036566 12384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: Bootstrap starting.
12:12:21.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.042881 12384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: Neither blocks nor log segments found. Creating new log.
12:12:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.045012 12384 log.cc:826] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: Log is configured to *not* fsync() on all Append() calls
12:12:21.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.048971 12384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: No bootstrap required, opened a new log
12:12:21.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.068671 12384 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.069294 12384 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:21.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.069479 12384 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1a62e5374c04b78b3ff6ede5074849e, State: Initialized, Role: FOLLOWER
12:12:21.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.070137 12384 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.072286 12393 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.072940 12393 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.073793 12384 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: configured and running, proceeding with master startup.
12:12:21.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.098280 12404 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:21.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.098764 12404 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:21.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.094565 12303 master_runner.cc:187] Error getting master registration for 127.11.220.62:34269: OK, instance_id { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" instance_seqno: 1783512736586059 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:21.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.115608 12303 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:21.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.137785 12301 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 7
12:12:21.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.150059 12338 tablet.cc:2406] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:21.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.155644 12301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: Bootstrap starting.
12:12:21.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.163107 12301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: Neither blocks nor log segments found. Creating new log.
12:12:21.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.164834 12301 log.cc:826] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: Log is configured to *not* fsync() on all Append() calls
12:12:21.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.168931 12301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: No bootstrap required, opened a new log
12:12:21.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.188222 12301 raft_consensus.cc:359] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.188967 12301 raft_consensus.cc:385] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:21.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.189230 12301 raft_consensus.cc:740] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129656c699a04c5f8fcce84a60c0f07d, State: Initialized, Role: FOLLOWER
12:12:21.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.190086 12301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.192472 12408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.193249 12408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.194141 12301 sys_catalog.cc:565] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: configured and running, proceeding with master startup.
12:12:21.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.223731 12419 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:21.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.224400 12419 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.218827 12227 master_runner.cc:187] Error getting master registration for 127.11.220.62:34269: OK, instance_id { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" instance_seqno: 1783512736586059 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.252115 12227 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:21.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.266407 12408 raft_consensus.cc:493] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:21.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.266959 12408 raft_consensus.cc:515] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.269630 12408 leader_election.cc:290] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bff7c34a401499aa4ae13afca98d84e (127.11.220.62:34269), f1a62e5374c04b78b3ff6ede5074849e (127.11.220.60:40605)
12:12:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.273106 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "129656c699a04c5f8fcce84a60c0f07d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1a62e5374c04b78b3ff6ede5074849e" is_pre_election: true
12:12:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.273980 12359 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129656c699a04c5f8fcce84a60c0f07d in term 0.
12:12:21.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.276542 12253 leader_election.cc:304] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129656c699a04c5f8fcce84a60c0f07d, f1a62e5374c04b78b3ff6ede5074849e; no voters: 
12:12:21.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.277761 12408 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:21.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.278090 12408 raft_consensus.cc:493] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:21.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.278404 12408 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 0 FOLLOWER]: Advancing to term 1
12:12:21.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.291177 12408 raft_consensus.cc:515] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.301463 12408 leader_election.cc:290] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [CANDIDATE]: Term 1 election: Requested vote from peers 8bff7c34a401499aa4ae13afca98d84e (127.11.220.62:34269), f1a62e5374c04b78b3ff6ede5074849e (127.11.220.60:40605)
12:12:21.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.302624 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "129656c699a04c5f8fcce84a60c0f07d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1a62e5374c04b78b3ff6ede5074849e"
12:12:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.303166 12359 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 0 FOLLOWER]: Advancing to term 1
12:12:21.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.313366 12225 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } attempt: 7
12:12:21.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.319250 12359 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129656c699a04c5f8fcce84a60c0f07d in term 1.
12:12:21.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.321033 12253 leader_election.cc:304] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129656c699a04c5f8fcce84a60c0f07d, f1a62e5374c04b78b3ff6ede5074849e; no voters: 
12:12:21.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.322889 12408 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 1 FOLLOWER]: Leader election won for term 1
12:12:21.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.349051 12408 raft_consensus.cc:697] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [term 1 LEADER]: Becoming Leader. State: Replica: 129656c699a04c5f8fcce84a60c0f07d, State: Running, Role: LEADER
12:12:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.350528 12408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.368712 12225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: Bootstrap starting.
12:12:21.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.375029 12255 tablet.cc:2406] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:21.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.380366 12225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: Neither blocks nor log segments found. Creating new log.
12:12:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.386708 12225 log.cc:826] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: Log is configured to *not* fsync() on all Append() calls
12:12:21.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.385638 12422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 129656c699a04c5f8fcce84a60c0f07d. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.388139 12422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: This master's current role is: LEADER
12:12:21.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.394147 12425 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:12:21.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.399993 12225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: No bootstrap required, opened a new log
12:12:21.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.409968 12425 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:12:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.429725 12225 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.430883 12225 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:21.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.431358 12225 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bff7c34a401499aa4ae13afca98d84e, State: Initialized, Role: FOLLOWER
12:12:21.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.432528 12225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } }
12:12:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.442641 12426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.446310 12426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.445976 12225 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: configured and running, proceeding with master startup.
12:12:21.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.447116 12199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "129656c699a04c5f8fcce84a60c0f07d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bff7c34a401499aa4ae13afca98d84e"
12:12:21.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.447774 12199 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 0 FOLLOWER]: Advancing to term 1
12:12:21.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.446426 12200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "129656c699a04c5f8fcce84a60c0f07d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bff7c34a401499aa4ae13afca98d84e" is_pre_election: true
12:12:21.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.457041 12199 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129656c699a04c5f8fcce84a60c0f07d in term 1.
12:12:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.480094 12359 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [term 1 FOLLOWER]: Refusing update from remote peer 129656c699a04c5f8fcce84a60c0f07d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:21.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.480752 12199 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [term 1 FOLLOWER]: Refusing update from remote peer 129656c699a04c5f8fcce84a60c0f07d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.481791 12408 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.482908 12422 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:21.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.535822 12393 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 129656c699a04c5f8fcce84a60c0f07d. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.540747 12393 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.548422 12179 tablet.cc:2406] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:21.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.548995 12426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 129656c699a04c5f8fcce84a60c0f07d. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.549649 12426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.556047 12427 mvcc.cc:204] Tried to move back new op lower bound from 7305268189049663488 to 7305268188584722432. Current Snapshot: MvccSnapshot[applied={T|T < 7305268189049663488}]
12:12:21.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.561970 12435 mvcc.cc:204] Tried to move back new op lower bound from 7305268189049663488 to 7305268188584722432. Current Snapshot: MvccSnapshot[applied={T|T < 7305268189049663488}]
12:12:21.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.570412 12393 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.571506 12393 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.581707 12433 mvcc.cc:204] Tried to move back new op lower bound from 7305268189049663488 to 7305268188584722432. Current Snapshot: MvccSnapshot[applied={T|T < 7305268189049663488}]
12:12:21.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.592926 12426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.593592 12426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e [sys.catalog]: This master's current role is: FOLLOWER
12:12:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.598007 12408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.598664 12408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: This master's current role is: LEADER
12:12:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.599264 12408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "129656c699a04c5f8fcce84a60c0f07d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bff7c34a401499aa4ae13afca98d84e" member_type: VOTER last_known_addr { host: "127.11.220.62" port: 34269 } } peers { permanent_uuid: "129656c699a04c5f8fcce84a60c0f07d" member_type: VOTER last_known_addr { host: "127.11.220.61" port: 39401 } } peers { permanent_uuid: "f1a62e5374c04b78b3ff6ede5074849e" member_type: VOTER last_known_addr { host: "127.11.220.60" port: 40605 } } }
12:12:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.599841 12408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d [sys.catalog]: This master's current role is: LEADER
12:12:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.600394 12425 catalog_manager.cc:1383] Generated new cluster ID: 68abf8c59a274accaf2f7aae2c4ccbe9
12:12:21.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.600649 12425 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:12:21.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.639991 12444 catalog_manager.cc:1295] Loaded cluster ID: 68abf8c59a274accaf2f7aae2c4ccbe9
12:12:21.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.640579 12444 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: loading cluster ID for follower catalog manager: success
12:12:21.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.644735 12425 catalog_manager.cc:1406] Generated new certificate authority record
12:12:21.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.651876 12444 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: acquiring CA information for follower catalog manager: Not found: root CA entry not found
12:12:21.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.655359 12425 catalog_manager.cc:1540] Loading token signing keys...
12:12:21.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:21.655830 12444 catalog_manager.cc:883] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
12:12:21.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.695720 12425 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: Generated new TSK 0
12:12:21.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.696926 12425 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.747187 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/logs
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data/info.pb
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.1:0
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.1
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.1
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.104290 12404 catalog_manager.cc:1295] Loaded cluster ID: 68abf8c59a274accaf2f7aae2c4ccbe9
12:12:22.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.104936 12404 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: loading cluster ID for follower catalog manager: success
12:12:22.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.120149 12404 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: acquiring CA information for follower catalog manager: success
12:12:22.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.127889 12404 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f1a62e5374c04b78b3ff6ede5074849e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:22.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.328229 12447 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:22.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.329241 12447 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:22.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.330168 12447 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:22.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.414127 12447 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:22.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.415776 12447 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.220.1
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.479514 12447 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.1:0
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data/info.pb
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.1
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.1
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/logs
12:12:22.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:22.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:22.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.482622 12447 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:22.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.485086 12447 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:22.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.519022 12456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:22.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.664038 12444 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: acquiring CA information for follower catalog manager: success
12:12:22.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.669529 12444 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 8bff7c34a401499aa4ae13afca98d84e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:24.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.521204 12455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:24.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:23.907583 12454 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 12447
12:12:24.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.813680 12447 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.297s	user 0.552s	sys 0.894s
12:12:24.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.814651 12447 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.298s	user 0.552s	sys 0.894s
12:12:24.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.821125 12447 server_base.cc:1061] running on GCE node
12:12:24.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.821249 12464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:24.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.822402 12447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:24.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.824767 12447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:24.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.826181 12447 hybrid_clock.cc:648] HybridClock initialized: now 1783512744826071 us; error 114 us; skew 500 ppm
12:12:24.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.827013 12447 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:24.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.833127 12447 webserver.cc:533] Webserver started at http://127.11.220.1:41693/ using document root <none> and password file <none>
12:12:24.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.834057 12447 fs_manager.cc:362] Metadata directory not provided
12:12:24.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.834275 12447 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:24.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.834759 12447 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.838984 12447 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data/instance:
12:12:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ab7ea72bb054c89adbb75260eb20139"
12:12:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:24 on dist-test-slave-vcgh"
12:12:24.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.840077 12447 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal/instance:
12:12:24.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ab7ea72bb054c89adbb75260eb20139"
12:12:24.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:24 on dist-test-slave-vcgh"
12:12:24.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.847702 12447 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
12:12:24.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.854882 12469 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:24.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.856087 12447 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
12:12:24.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.856463 12447 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ab7ea72bb054c89adbb75260eb20139"
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:24 on dist-test-slave-vcgh"
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.856873 12447 fs_report.cc:389] FS layout report
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data/data
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:24.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:24.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:24.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.924867 12447 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:24.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.926287 12447 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:24.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.926697 12447 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:24.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.929317 12447 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:24.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.933517 12447 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:24.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.933719 12447 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:24.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.934008 12447 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:24.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.934177 12447 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:25.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.082513 12447 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.1:40891
12:12:25.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.082614 12582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.1:40891 every 8 connection(s)
12:12:25.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.085253 12447 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/data/info.pb
12:12:25.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.091172 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12447
12:12:25.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.091734 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-0/wal/instance
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.104653 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/logs
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data/info.pb
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:25.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.2:0
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.2
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.2
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:25.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.130311 12583 heartbeater.cc:344] Connected to a master server at 127.11.220.60:40605
12:12:25.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.130808 12583 heartbeater.cc:461] Registering TS with master...
12:12:25.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.132210 12583 heartbeater.cc:507] Master 127.11.220.60:40605 requested a full tablet report, sending...
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.132987 12584 heartbeater.cc:344] Connected to a master server at 127.11.220.61:39401
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.133145 12585 heartbeater.cc:344] Connected to a master server at 127.11.220.62:34269
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.133314 12584 heartbeater.cc:461] Registering TS with master...
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.133488 12585 heartbeater.cc:461] Registering TS with master...
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.134184 12584 heartbeater.cc:507] Master 127.11.220.61:39401 requested a full tablet report, sending...
12:12:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.134361 12585 heartbeater.cc:507] Master 127.11.220.62:34269 requested a full tablet report, sending...
12:12:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.135748 12349 ts_manager.cc:194] Registered new tserver with Master: 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1:40891)
12:12:25.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.136826 12266 ts_manager.cc:194] Registered new tserver with Master: 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1:40891)
12:12:25.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.137457 12190 ts_manager.cc:194] Registered new tserver with Master: 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1:40891)
12:12:25.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.139346 12266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.220.1:54687
12:12:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.415508 12591 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.416013 12591 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.416586 12591 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:25.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.451063 12591 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:25.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.451958 12591 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.220.2
12:12:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.488272 12591 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:25.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.2:0
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data/info.pb
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.2
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.2
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/logs
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:25.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:25.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:25.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.489940 12591 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:25.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.491571 12591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.503328 12599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:26.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.142341 12584 heartbeater.cc:499] Master 127.11.220.61:39401 was elected leader, sending a full tablet report...
12:12:26.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.504511 12600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.905005 12598 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 12591
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.997979 12598 kernel_stack_watchdog.cc:198] Thread 12591 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.998441 12591 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.493s	user 0.001s	sys 0.000s
12:12:26.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.998759 12591 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.494s	user 0.001s	sys 0.000s
12:12:27.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.003971 12601 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1498 milliseconds
12:12:27.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.005916 12602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:27.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.005976 12591 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:27.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.007139 12591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:27.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.009284 12591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:27.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.010630 12591 hybrid_clock.cc:648] HybridClock initialized: now 1783512747010588 us; error 36 us; skew 500 ppm
12:12:27.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.011448 12591 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:27.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.019328 12591 webserver.cc:533] Webserver started at http://127.11.220.2:37081/ using document root <none> and password file <none>
12:12:27.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.020160 12591 fs_manager.cc:362] Metadata directory not provided
12:12:27.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.020341 12591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:27.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.020754 12591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:27.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.025049 12591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data/instance:
12:12:27.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ac0e49cb3374fe69587da31db9ad3da"
12:12:27.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:27 on dist-test-slave-vcgh"
12:12:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.026031 12591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal/instance:
12:12:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ac0e49cb3374fe69587da31db9ad3da"
12:12:27.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:27 on dist-test-slave-vcgh"
12:12:27.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.033046 12591 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
12:12:27.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.038211 12617 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:27.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.039191 12591 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
12:12:27.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.039517 12591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal
12:12:27.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8ac0e49cb3374fe69587da31db9ad3da"
12:12:27.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:27 on dist-test-slave-vcgh"
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.039822 12591 fs_report.cc:389] FS layout report
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data/data
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:27.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.088068 12591 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.090126 12591 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:27.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.090701 12591 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:27.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.094041 12591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:27.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.098718 12591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:27.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.098922 12591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:27.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.099104 12591 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:27.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.099232 12591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:27.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.230548 12591 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.2:40199
12:12:27.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.230647 12730 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.2:40199 every 8 connection(s)
12:12:27.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.232995 12591 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/data/info.pb
12:12:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.239241 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12591
12:12:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.239645 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-1/wal/instance
12:12:27.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.249400 12144 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/logs
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data/info.pb
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.3:0
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.3
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.3
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.271050 12731 heartbeater.cc:344] Connected to a master server at 127.11.220.60:40605
12:12:27.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.271562 12731 heartbeater.cc:461] Registering TS with master...
12:12:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.272897 12731 heartbeater.cc:507] Master 127.11.220.60:40605 requested a full tablet report, sending...
12:12:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.273124 12733 heartbeater.cc:344] Connected to a master server at 127.11.220.62:34269
12:12:27.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.273468 12733 heartbeater.cc:461] Registering TS with master...
12:12:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.274358 12733 heartbeater.cc:507] Master 127.11.220.62:34269 requested a full tablet report, sending...
12:12:27.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.275828 12349 ts_manager.cc:194] Registered new tserver with Master: 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199)
12:12:27.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.276726 12732 heartbeater.cc:344] Connected to a master server at 127.11.220.61:39401
12:12:27.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.277045 12732 heartbeater.cc:461] Registering TS with master...
12:12:27.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.277024 12190 ts_manager.cc:194] Registered new tserver with Master: 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199)
12:12:27.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.277889 12732 heartbeater.cc:507] Master 127.11.220.61:39401 requested a full tablet report, sending...
12:12:27.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.279644 12266 ts_manager.cc:194] Registered new tserver with Master: 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199)
12:12:27.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.281026 12266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.220.2:40505
12:12:27.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.551285 12741 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:27.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.551786 12741 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:27.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.552356 12741 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:27.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.584002 12741 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:27.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.584980 12741 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.220.3
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.630959 12741 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.220.20:42567
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.220.3:0
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:27.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data/info.pb
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.220.3
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.220.62:34269,127.11.220.61:39401,127.11.220.60:40605
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.220.3
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/logs
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:27.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.632611 12741 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:27.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:27.634287 12741 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:27.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.645921 12747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:28.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.283849 12732 heartbeater.cc:499] Master 127.11.220.61:39401 was elected leader, sending a full tablet report...
12:12:28.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:27.647136 12748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:28.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:28.840628 12750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:28.843014 12749 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1192 milliseconds
12:12:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.843148 12741 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:28.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.844314 12741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:28.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.846388 12741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:28.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.847705 12741 hybrid_clock.cc:648] HybridClock initialized: now 1783512748847676 us; error 32 us; skew 500 ppm
12:12:28.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.848501 12741 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:28.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.854400 12741 webserver.cc:533] Webserver started at http://127.11.220.3:45499/ using document root <none> and password file <none>
12:12:28.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.855180 12741 fs_manager.cc:362] Metadata directory not provided
12:12:28.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.855350 12741 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:28.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.855786 12741 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.859942 12741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data/instance:
12:12:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7aeee9093f324ddcb4adc4ff322e3a04"
12:12:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:28 on dist-test-slave-vcgh"
12:12:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.860980 12741 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal/instance:
12:12:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7aeee9093f324ddcb4adc4ff322e3a04"
12:12:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:28 on dist-test-slave-vcgh"
12:12:28.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.867463 12741 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
12:12:28.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.873667 12757 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:28.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.874663 12741 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.874936 12741 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7aeee9093f324ddcb4adc4ff322e3a04"
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:28 on dist-test-slave-vcgh"
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.875208 12741 fs_report.cc:389] FS layout report
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data/data
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:28.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:28.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:28.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.932192 12741 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:28.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.933692 12741 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.934074 12741 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.936697 12741 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:28.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.940533 12741 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:28.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.940725 12741 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
12:12:28.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.940922 12741 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:28.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:28.941051 12741 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.079417 12741 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.3:44361
12:12:29.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.079598 12870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.220.3:44361 every 8 connection(s)
12:12:29.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.082016 12741 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/data/info.pb
12:12:29.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.092381 12144 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 12741
12:12:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.093107 12144 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2508034278709405738/ts-2/wal/instance
12:12:29.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.129649 12872 heartbeater.cc:344] Connected to a master server at 127.11.220.61:39401
12:12:29.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.130136 12872 heartbeater.cc:461] Registering TS with master...
12:12:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.130551 12873 heartbeater.cc:344] Connected to a master server at 127.11.220.62:34269
12:12:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.130870 12873 heartbeater.cc:461] Registering TS with master...
12:12:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.130888 12871 heartbeater.cc:344] Connected to a master server at 127.11.220.60:40605
12:12:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.131466 12872 heartbeater.cc:507] Master 127.11.220.61:39401 requested a full tablet report, sending...
12:12:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.131547 12871 heartbeater.cc:461] Registering TS with master...
12:12:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.131964 12873 heartbeater.cc:507] Master 127.11.220.62:34269 requested a full tablet report, sending...
12:12:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.132447 12871 heartbeater.cc:507] Master 127.11.220.60:40605 requested a full tablet report, sending...
12:12:29.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.134125 12266 ts_manager.cc:194] Registered new tserver with Master: 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3:44361)
12:12:29.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.134789 12190 ts_manager.cc:194] Registered new tserver with Master: 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3:44361)
12:12:29.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.135413 12349 ts_manager.cc:194] Registered new tserver with Master: 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3:44361)
12:12:29.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.135756 12266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.220.3:60623
12:12:29.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.155258 12144 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:12:29.166 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:29.166 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:12:29.170 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.220.62"
      port: 34269
    }
    bound_http_address {
      host: "127.11.220.62"
      port: 34641
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.220.61"
      port: 39401
    }
    bound_http_address {
      host: "127.11.220.61"
      port: 39255
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.220.60"
      port: 40605
    }
    bound_http_address {
      host: "127.11.220.60"
      port: 36765
    }
  }
}

12:12:29.170 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:12:29.172 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.220.1"
      port: 40891
    }
    bound_http_address {
      host: "127.11.220.1"
      port: 41693
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.220.2"
      port: 40199
    }
    bound_http_address {
      host: "127.11.220.2"
      port: 37081
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.220.3"
      port: 44361
    }
    bound_http_address {
      host: "127.11.220.3"
      port: 45499
    }
  }
}

12:12:29.172 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:12:29.174 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:29.248 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:29.257 [DEBUG - main] (DefaultChannelId.java:84) -Dio.netty.processId: 11390 (auto-detected)
12:12:29.258 [DEBUG - main] (NetUtil.java:149) -Djava.net.preferIPv4Stack: true
12:12:29.258 [DEBUG - main] (NetUtil.java:150) -Djava.net.preferIPv6Addresses: false
12:12:29.260 [DEBUG - main] (NetUtilInitializations.java:145) Loopback interface: lo (lo, 127.0.0.1)
12:12:29.261 [DEBUG - main] (NetUtil.java:198) /proc/sys/net/core/somaxconn: 4096
12:12:29.262 [DEBUG - main] (DefaultChannelId.java:106) -Dio.netty.machineId: 02:42:3d:ff:fe:b3:50:e3 (auto-detected)
12:12:29.287 [DEBUG - main] (ByteBufUtil.java:89) -Dio.netty.allocator.type: pooled
12:12:29.287 [DEBUG - main] (ByteBufUtil.java:101) -Dio.netty.threadLocalDirectBufferSize: 0
12:12:29.287 [DEBUG - main] (ByteBufUtil.java:104) -Dio.netty.maxThreadLocalCharBufferSize: 16384
12:12:29.294 [DEBUG - main] (ChannelInitializerExtensions.java:54) -Dio.netty.bootstrap.extensions: null
12:12:29.299 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:29.300 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:29.352 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.38.60:33275(127.11.38.60:33275)] Successfully connected to peer
12:12:29.352 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.38.61:36393(127.11.38.61:36393)] Successfully connected to peer
12:12:29.356 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.38.62:34839(127.11.38.62:34839)] Successfully connected to peer
12:12:29.367 [DEBUG - kudu-nio-0] (AbstractByteBuf.java:63) -Dorg.apache.kudu.shaded.io.netty.buffer.checkAccessible: true
12:12:29.367 [DEBUG - kudu-nio-0] (AbstractByteBuf.java:64) -Dorg.apache.kudu.shaded.io.netty.buffer.checkBounds: true
12:12:29.367 [DEBUG - kudu-nio-0] (ResourceLeakDetectorFactory.java:196) Loaded default ResourceLeakDetector: org.apache.kudu.shaded.io.netty.util.ResourceLeakDetector@c8bbdcd
12:12:29.371 [DEBUG - kudu-nio-2] (Recycler.java:96) -Dio.netty.recycler.maxCapacityPerThread: 4096
12:12:29.372 [DEBUG - kudu-nio-2] (Recycler.java:97) -Dio.netty.recycler.ratio: 8
12:12:29.372 [DEBUG - kudu-nio-2] (Recycler.java:98) -Dio.netty.recycler.chunkSize: 32
12:12:29.372 [DEBUG - kudu-nio-2] (Recycler.java:99) -Dio.netty.recycler.blocking: false
12:12:29.372 [DEBUG - kudu-nio-2] (Recycler.java:100) -Dio.netty.recycler.batchFastThreadLocalOnly: true
12:12:29.447 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.60
12:12:29.447 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.61
12:12:29.449 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.62
12:12:29.647 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:29.652 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:29.653 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:29.690 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8be6365c, L:/127.0.0.1:60834 - R:/127.11.38.62:34839] using SASL/PLAIN
12:12:29.690 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf4510e86, L:/127.0.0.1:42140 - R:/127.11.38.61:36393] using SASL/PLAIN
12:12:29.694 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa00e7d5b, L:/127.0.0.1:44384 - R:/127.11.38.60:33275] using SASL/PLAIN
12:12:29.732 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:29.733 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=524), Traces: [0ms] refreshing cache from master, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [497ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: OK, [498ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: OK, [500ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: OK, deferred=null) after lookup
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.794026 11536 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42140:
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:29.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:29.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:29.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:29.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000\006\001d\000\000\000\007\001\310\000\000\000"
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:29.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:29.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:29.797771 11536 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:12:29.864 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:29.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.905323 11783 tablet_service.cc:1511] Processing CreateTablet for tablet c50567019d32463bbb9d67af32b8657e (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:29.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.907617 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50567019d32463bbb9d67af32b8657e. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.906697 11925 tablet_service.cc:1511] Processing CreateTablet for tablet c01bbfc489f7433982240298de513cdd (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:29.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.910775 11784 tablet_service.cc:1511] Processing CreateTablet for tablet c01bbfc489f7433982240298de513cdd (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:29.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.913053 11784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bbfc489f7433982240298de513cdd. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.913249 11924 tablet_service.cc:1511] Processing CreateTablet for tablet c50567019d32463bbb9d67af32b8657e (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:29.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.915222 11924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50567019d32463bbb9d67af32b8657e. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.918787 12066 tablet_service.cc:1511] Processing CreateTablet for tablet c50567019d32463bbb9d67af32b8657e (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:29.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.920534 11925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bbfc489f7433982240298de513cdd. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.920807 12066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50567019d32463bbb9d67af32b8657e. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.914754 12067 tablet_service.cc:1511] Processing CreateTablet for tablet c01bbfc489f7433982240298de513cdd (DEFAULT_TABLE table=replication_test_table [id=98275711d6cc4f8a86d5f78c3f787705]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:29.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.927292 12067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01bbfc489f7433982240298de513cdd. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:29.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.960587 12908 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Bootstrap starting.
12:12:29.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.968670 12908 tablet_bootstrap.cc:654] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Neither blocks nor log segments found. Creating new log.
12:12:29.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.968912 12910 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: Bootstrap starting.
12:12:29.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.971298 12908 log.cc:826] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Log is configured to *not* fsync() on all Append() calls
12:12:29.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.979231 12910 tablet_bootstrap.cc:654] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: Neither blocks nor log segments found. Creating new log.
12:12:29.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.981686 12910 log.cc:826] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: Log is configured to *not* fsync() on all Append() calls
12:12:29.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.987722 12908 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: No bootstrap required, opened a new log
12:12:29.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.989749 12909 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: Bootstrap starting.
12:12:29.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:29.988672 12908 ts_tablet_manager.cc:1403] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.015s
12:12:30.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.001405 12909 tablet_bootstrap.cc:654] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: Neither blocks nor log segments found. Creating new log.
12:12:30.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.003870 12909 log.cc:826] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: Log is configured to *not* fsync() on all Append() calls
12:12:30.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.005522 12910 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: No bootstrap required, opened a new log
12:12:30.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.006037 12910 ts_tablet_manager.cc:1403] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.009s
12:12:30.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.028918 12909 tablet_bootstrap.cc:492] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: No bootstrap required, opened a new log
12:12:30.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.029771 12909 ts_tablet_manager.cc:1403] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.003s
12:12:30.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.030742 12908 raft_consensus.cc:359] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.031852 12908 raft_consensus.cc:385] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.032398 12908 raft_consensus.cc:740] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed87f31e9c14b1f9d38ececa4c6fe5e, State: Initialized, Role: FOLLOWER
12:12:30.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.035423 12908 consensus_queue.cc:260] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.044817 12910 raft_consensus.cc:359] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.046155 12910 raft_consensus.cc:385] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.046351 12908 ts_tablet_manager.cc:1434] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Time spent starting tablet: real 0.051s	user 0.036s	sys 0.000s
12:12:30.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.046746 12910 raft_consensus.cc:740] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa64cca4754485089da2caa96ce2824, State: Initialized, Role: FOLLOWER
12:12:30.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.047863 12910 consensus_queue.cc:260] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.058214 12910 ts_tablet_manager.cc:1434] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824: Time spent starting tablet: real 0.052s	user 0.036s	sys 0.001s
12:12:30.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.062006 12908 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Bootstrap starting.
12:12:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.071691 12910 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: Bootstrap starting.
12:12:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.070719 12909 raft_consensus.cc:359] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.074061 12909 raft_consensus.cc:385] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.074626 12909 raft_consensus.cc:740] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bfab9f4b9384a25a61717f3e0e74b1b, State: Initialized, Role: FOLLOWER
12:12:30.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.076602 12909 consensus_queue.cc:260] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.080546 12908 tablet_bootstrap.cc:654] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Neither blocks nor log segments found. Creating new log.
12:12:30.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.085450 12910 tablet_bootstrap.cc:654] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: Neither blocks nor log segments found. Creating new log.
12:12:30.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.102234 12909 ts_tablet_manager.cc:1434] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b: Time spent starting tablet: real 0.072s	user 0.028s	sys 0.004s
12:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.111431 12915 raft_consensus.cc:493] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.112004 12915 raft_consensus.cc:515] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.118412 12915 leader_election.cc:290] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2:44311), 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:30.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.120965 12910 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: No bootstrap required, opened a new log
12:12:30.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.123065 12910 ts_tablet_manager.cc:1403] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.009s
12:12:30.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.125852 12909 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: Bootstrap starting.
12:12:30.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.127966 12910 raft_consensus.cc:359] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.130774 12910 raft_consensus.cc:385] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.131539 12910 raft_consensus.cc:740] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa64cca4754485089da2caa96ce2824, State: Initialized, Role: FOLLOWER
12:12:30.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.133083 12910 consensus_queue.cc:260] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.138587 12872 heartbeater.cc:499] Master 127.11.220.61:39401 was elected leader, sending a full tablet report...
12:12:30.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.149677 12910 ts_tablet_manager.cc:1434] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
12:12:30.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.160867 12909 tablet_bootstrap.cc:654] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: Neither blocks nor log segments found. Creating new log.
12:12:30.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.169922 12908 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: No bootstrap required, opened a new log
12:12:30.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.170339 12908 ts_tablet_manager.cc:1403] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Time spent bootstrapping tablet: real 0.109s	user 0.045s	sys 0.032s
12:12:30.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.174317 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50567019d32463bbb9d67af32b8657e" candidate_uuid: "1fa64cca4754485089da2caa96ce2824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" is_pre_election: true
12:12:30.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.174285 12908 raft_consensus.cc:359] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.175004 12908 raft_consensus.cc:385] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.175191 11945 raft_consensus.cc:2468] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa64cca4754485089da2caa96ce2824 in term 0.
12:12:30.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.175261 12908 raft_consensus.cc:740] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed87f31e9c14b1f9d38ececa4c6fe5e, State: Initialized, Role: FOLLOWER
12:12:30.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.175887 12908 consensus_queue.cc:260] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.177805 12908 ts_tablet_manager.cc:1434] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
12:12:30.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.184396 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50567019d32463bbb9d67af32b8657e" candidate_uuid: "1fa64cca4754485089da2caa96ce2824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" is_pre_election: true
12:12:30.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.185333 12087 raft_consensus.cc:2468] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fa64cca4754485089da2caa96ce2824 in term 0.
12:12:30.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:30.186676 11857 tablet.cc:2406] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:30.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.186822 11740 leader_election.cc:304] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa64cca4754485089da2caa96ce2824, 6bfab9f4b9384a25a61717f3e0e74b1b; no voters: 
12:12:30.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.187570 12915 raft_consensus.cc:2804] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:30.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.187896 12915 raft_consensus.cc:493] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:30.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.188195 12915 raft_consensus.cc:3060] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Advancing to term 1
12:12:30.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.194262 12915 raft_consensus.cc:515] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.195731 12915 leader_election.cc:290] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [CANDIDATE]: Term 1 election: Requested vote from peers 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2:44311), 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:30.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.196835 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50567019d32463bbb9d67af32b8657e" candidate_uuid: "1fa64cca4754485089da2caa96ce2824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e"
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.197321 12087 raft_consensus.cc:3060] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Advancing to term 1
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.197717 11945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50567019d32463bbb9d67af32b8657e" candidate_uuid: "1fa64cca4754485089da2caa96ce2824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b"
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.198215 11945 raft_consensus.cc:3060] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Advancing to term 1
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.198717 12909 tablet_bootstrap.cc:492] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: No bootstrap required, opened a new log
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.199137 12909 ts_tablet_manager.cc:1403] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.000s
12:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:30.201058 12139 tablet.cc:2406] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.202419 12909 raft_consensus.cc:359] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.203047 12909 raft_consensus.cc:385] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.203303 12909 raft_consensus.cc:740] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bfab9f4b9384a25a61717f3e0e74b1b, State: Initialized, Role: FOLLOWER
12:12:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.203939 12087 raft_consensus.cc:2468] T c50567019d32463bbb9d67af32b8657e P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa64cca4754485089da2caa96ce2824 in term 1.
12:12:30.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.204025 12909 consensus_queue.cc:260] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.205241 11737 leader_election.cc:304] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa64cca4754485089da2caa96ce2824, 8ed87f31e9c14b1f9d38ececa4c6fe5e; no voters: 
12:12:30.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.205933 12909 ts_tablet_manager.cc:1434] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
12:12:30.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.206022 12915 raft_consensus.cc:2804] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 1 FOLLOWER]: Leader election won for term 1
12:12:30.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.219206 11945 raft_consensus.cc:2468] T c50567019d32463bbb9d67af32b8657e P 6bfab9f4b9384a25a61717f3e0e74b1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fa64cca4754485089da2caa96ce2824 in term 1.
12:12:30.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.221306 12915 raft_consensus.cc:697] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [term 1 LEADER]: Becoming Leader. State: Replica: 1fa64cca4754485089da2caa96ce2824, State: Running, Role: LEADER
12:12:30.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.222293 12915 consensus_queue.cc:237] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } }
12:12:30.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.241281 11536 catalog_manager.cc:5697] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fa64cca4754485089da2caa96ce2824 (127.11.38.1). New cstate: current_term: 1 leader_uuid: "1fa64cca4754485089da2caa96ce2824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } health_report { overall_health: UNKNOWN } } }
12:12:30.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:30.313558 11997 tablet.cc:2406] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.423720 12917 raft_consensus.cc:493] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.424099 12917 raft_consensus.cc:515] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.426723 12917 leader_election.cc:290] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fa64cca4754485089da2caa96ce2824 (127.11.38.1:37833), 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.437966 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01bbfc489f7433982240298de513cdd" candidate_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" is_pre_election: true
12:12:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.438472 12087 raft_consensus.cc:2468] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bfab9f4b9384a25a61717f3e0e74b1b in term 0.
12:12:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.438269 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01bbfc489f7433982240298de513cdd" candidate_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa64cca4754485089da2caa96ce2824" is_pre_election: true
12:12:30.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.439002 11804 raft_consensus.cc:2468] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bfab9f4b9384a25a61717f3e0e74b1b in term 0.
12:12:30.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.439471 11878 leader_election.cc:304] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bfab9f4b9384a25a61717f3e0e74b1b, 8ed87f31e9c14b1f9d38ececa4c6fe5e; no voters: 
12:12:30.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.440181 12917 raft_consensus.cc:2804] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:30.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.440521 12917 raft_consensus.cc:493] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:30.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.440840 12917 raft_consensus.cc:3060] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 0 FOLLOWER]: Advancing to term 1
12:12:30.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.445081 12917 raft_consensus.cc:515] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.446738 12917 leader_election.cc:290] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [CANDIDATE]: Term 1 election: Requested vote from peers 1fa64cca4754485089da2caa96ce2824 (127.11.38.1:37833), 8ed87f31e9c14b1f9d38ececa4c6fe5e (127.11.38.3:39999)
12:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.447363 11804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01bbfc489f7433982240298de513cdd" candidate_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fa64cca4754485089da2caa96ce2824"
12:12:30.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.447781 11804 raft_consensus.cc:3060] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 0 FOLLOWER]: Advancing to term 1
12:12:30.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.447710 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01bbfc489f7433982240298de513cdd" candidate_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e"
12:12:30.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.448170 12087 raft_consensus.cc:3060] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 0 FOLLOWER]: Advancing to term 1
12:12:30.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.452016 11804 raft_consensus.cc:2468] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bfab9f4b9384a25a61717f3e0e74b1b in term 1.
12:12:30.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.452571 12087 raft_consensus.cc:2468] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bfab9f4b9384a25a61717f3e0e74b1b in term 1.
12:12:30.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.453018 11880 leader_election.cc:304] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fa64cca4754485089da2caa96ce2824, 6bfab9f4b9384a25a61717f3e0e74b1b; no voters: 
12:12:30.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.453715 12917 raft_consensus.cc:2804] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 1 FOLLOWER]: Leader election won for term 1
12:12:30.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.455200 12917 raft_consensus.cc:697] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [term 1 LEADER]: Becoming Leader. State: Replica: 6bfab9f4b9384a25a61717f3e0e74b1b, State: Running, Role: LEADER
12:12:30.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.456488 12917 consensus_queue.cc:237] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } }
12:12:30.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.466372 11536 catalog_manager.cc:5697] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bfab9f4b9384a25a61717f3e0e74b1b (127.11.38.2). New cstate: current_term: 1 leader_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 } health_report { overall_health: HEALTHY } } }
12:12:30.637 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:30.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.652976 12915 consensus_queue.cc:1048] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bfab9f4b9384a25a61717f3e0e74b1b" member_type: VOTER last_known_addr { host: "127.11.38.2" port: 44311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:30.659 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:30.659 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:30.666 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299993, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299993}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299993, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299993}]
12:12:30.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=24), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.38.61:36393, [8ms] Sub RPC GetTableLocations: received response from server master-127.11.38.61:36393: OK, deferred=null) after lookup
12:12:30.680 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)] connecting to peer
12:12:30.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.681295 12915 consensus_queue.cc:1048] T c50567019d32463bbb9d67af32b8657e P 1fa64cca4754485089da2caa96ce2824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:30.685 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)] Successfully connected to peer
12:12:30.787 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:30.795 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x1c0327b7, L:/127.0.0.1:32814 - R:/127.11.38.2:44311] using TOKEN/null
12:12:30.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.810055 12087 raft_consensus.cc:1275] T c01bbfc489f7433982240298de513cdd P 8ed87f31e9c14b1f9d38ececa4c6fe5e [term 1 FOLLOWER]: Refusing update from remote peer 6bfab9f4b9384a25a61717f3e0e74b1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:30.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.810858 11804 raft_consensus.cc:1275] T c01bbfc489f7433982240298de513cdd P 1fa64cca4754485089da2caa96ce2824 [term 1 FOLLOWER]: Refusing update from remote peer 6bfab9f4b9384a25a61717f3e0e74b1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:30.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.812463 12929 consensus_queue.cc:1048] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fa64cca4754485089da2caa96ce2824" member_type: VOTER last_known_addr { host: "127.11.38.1" port: 37833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:30.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.814342 12929 consensus_queue.cc:1048] T c01bbfc489f7433982240298de513cdd P 6bfab9f4b9384a25a61717f3e0e74b1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed87f31e9c14b1f9d38ececa4c6fe5e" member_type: VOTER last_known_addr { host: "127.11.38.3" port: 39999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:30.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.836714 12933 mvcc.cc:204] Tried to move back new op lower bound from 7305268227301314560 to 7305268225876787200. Current Snapshot: MvccSnapshot[applied={T|T < 7305268227301314560}]
12:12:30.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:30.855644 12939 mvcc.cc:204] Tried to move back new op lower bound from 7305268227301314560 to 7305268225876787200. Current Snapshot: MvccSnapshot[applied={T|T < 7305268227301314560}]
12:12:30.972 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:30.973 [DEBUG - main] (Connection.java:748) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] connecting to peer
12:12:30.975 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] Successfully connected to peer
12:12:31.006 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.010 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xbc38e446, L:/127.0.0.1:41458 - R:/127.11.38.1:37833] using TOKEN/null
12:12:31.108 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:31.111 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:31.112 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:31.113 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:31.114 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:31.115 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:31.117 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:31.118 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:31.126 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:31.146 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:31.154 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:31.164 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.164 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.168 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x642a4b78, L:/127.0.0.1:33254 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:31.172 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:31.172 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbcaaf77f, L:/127.0.0.1:33936 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:31.172 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=60), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [59ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:31.183 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.188 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xff5ea542, L:/127.0.0.1:48254 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:31.191 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:31.193 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:31.194 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.38.61:36393(127.11.38.61:36393)] Successfully connected to peer
12:12:31.198 [DEBUG - main] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:31.199 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.61
12:12:31.209 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.38.60:33275(127.11.38.60:33275)] Successfully connected to peer
12:12:31.216 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.220 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1a4639f5, L:/127.0.0.1:42156 - R:/127.11.38.61:36393] using SASL/PLAIN
12:12:31.224 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:31.225 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=43), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: OK, deferred=null) after lookup
12:12:31.229 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.38.62:34839(127.11.38.62:34839)] Successfully connected to peer
12:12:31.232 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.60
12:12:31.249 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:31.266 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.273 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf1a3d95c, L:/127.0.0.1:44386 - R:/127.11.38.60:33275] using SASL/PLAIN
12:12:31.278 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:31.286 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:31.287 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd87de665, L:/127.0.0.1:60842 - R:/127.11.38.62:34839] using TOKEN/null
12:12:31.287 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:31.288 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.309216 12266 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33254:
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:12:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\001\000\000\000\000\007\0012\000\000\000"
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:12:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.312881 12266 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:12:31.359 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:31.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.394590 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 22a5495a66ce4a0b99bd3319144b24a3 (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:31.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.396463 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a5495a66ce4a0b99bd3319144b24a3. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.447362 12984 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Bootstrap starting.
12:12:31.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.458458 12517 tablet_service.cc:1511] Processing CreateTablet for tablet 22a5495a66ce4a0b99bd3319144b24a3 (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.460640 12517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a5495a66ce4a0b99bd3319144b24a3. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.461606 12984 tablet_bootstrap.cc:654] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Neither blocks nor log segments found. Creating new log.
12:12:31.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.462688 12805 tablet_service.cc:1511] Processing CreateTablet for tablet 22a5495a66ce4a0b99bd3319144b24a3 (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 0 <= VALUES < 50
12:12:31.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.463876 12984 log.cc:826] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Log is configured to *not* fsync() on all Append() calls
12:12:31.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.464496 12805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a5495a66ce4a0b99bd3319144b24a3. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.470094 12984 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: No bootstrap required, opened a new log
12:12:31.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.471083 12984 ts_tablet_manager.cc:1403] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
12:12:31.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.483896 12986 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Bootstrap starting.
12:12:31.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.490129 12987 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Bootstrap starting.
12:12:31.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.490584 12986 tablet_bootstrap.cc:654] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Neither blocks nor log segments found. Creating new log.
12:12:31.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.496009 12986 log.cc:826] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Log is configured to *not* fsync() on all Append() calls
12:12:31.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.497545 12987 tablet_bootstrap.cc:654] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Neither blocks nor log segments found. Creating new log.
12:12:31.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.499886 12987 log.cc:826] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Log is configured to *not* fsync() on all Append() calls
12:12:31.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.500140 12984 raft_consensus.cc:359] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.500839 12984 raft_consensus.cc:385] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.501099 12984 raft_consensus.cc:740] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac0e49cb3374fe69587da31db9ad3da, State: Initialized, Role: FOLLOWER
12:12:31.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.502440 12984 consensus_queue.cc:260] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.503225 12986 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: No bootstrap required, opened a new log
12:12:31.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.503720 12986 ts_tablet_manager.cc:1403] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.002s
12:12:31.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.504892 12987 tablet_bootstrap.cc:492] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: No bootstrap required, opened a new log
12:12:31.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.505329 12987 ts_tablet_manager.cc:1403] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
12:12:31.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.505612 12984 ts_tablet_manager.cc:1434] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Time spent starting tablet: real 0.034s	user 0.026s	sys 0.005s
12:12:31.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.512393 12736 tablet.cc:2406] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:31.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.528133 12986 raft_consensus.cc:359] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.528802 12986 raft_consensus.cc:385] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.529083 12986 raft_consensus.cc:740] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab7ea72bb054c89adbb75260eb20139, State: Initialized, Role: FOLLOWER
12:12:31.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.529867 12986 consensus_queue.cc:260] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.530543 12987 raft_consensus.cc:359] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.531272 12987 raft_consensus.cc:385] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.531551 12987 raft_consensus.cc:740] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeee9093f324ddcb4adc4ff322e3a04, State: Initialized, Role: FOLLOWER
12:12:31.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.532636 12987 consensus_queue.cc:260] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.535035 12986 ts_tablet_manager.cc:1434] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Time spent starting tablet: real 0.031s	user 0.020s	sys 0.006s
12:12:31.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.537725 12987 ts_tablet_manager.cc:1434] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Time spent starting tablet: real 0.032s	user 0.022s	sys 0.002s
12:12:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.567763 12993 raft_consensus.cc:493] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.568189 12993 raft_consensus.cc:515] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.571017 12993 leader_election.cc:290] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199), 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1:40891)
12:12:31.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.582158 12685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a5495a66ce4a0b99bd3319144b24a3" candidate_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac0e49cb3374fe69587da31db9ad3da" is_pre_election: true
12:12:31.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.582899 12685 raft_consensus.cc:2468] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aeee9093f324ddcb4adc4ff322e3a04 in term 0.
12:12:31.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.583585 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a5495a66ce4a0b99bd3319144b24a3" candidate_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ab7ea72bb054c89adbb75260eb20139" is_pre_election: true
12:12:31.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.584137 12758 leader_election.cc:304] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aeee9093f324ddcb4adc4ff322e3a04, 8ac0e49cb3374fe69587da31db9ad3da; no voters: 
12:12:31.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.584396 12538 raft_consensus.cc:2468] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aeee9093f324ddcb4adc4ff322e3a04 in term 0.
12:12:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.584982 12993 raft_consensus.cc:2804] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.585278 12993 raft_consensus.cc:493] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.585594 12993 raft_consensus.cc:3060] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Advancing to term 1
12:12:31.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.590135 12993 raft_consensus.cc:515] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.591537 12993 leader_election.cc:290] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [CANDIDATE]: Term 1 election: Requested vote from peers 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199), 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1:40891)
12:12:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.592164 12685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a5495a66ce4a0b99bd3319144b24a3" candidate_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac0e49cb3374fe69587da31db9ad3da"
12:12:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.592348 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a5495a66ce4a0b99bd3319144b24a3" candidate_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ab7ea72bb054c89adbb75260eb20139"
12:12:31.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.592582 12685 raft_consensus.cc:3060] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Advancing to term 1
12:12:31.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.592749 12538 raft_consensus.cc:3060] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Advancing to term 1
12:12:31.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.597085 12685 raft_consensus.cc:2468] T 22a5495a66ce4a0b99bd3319144b24a3 P 8ac0e49cb3374fe69587da31db9ad3da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aeee9093f324ddcb4adc4ff322e3a04 in term 1.
12:12:31.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.597240 12538 raft_consensus.cc:2468] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aeee9093f324ddcb4adc4ff322e3a04 in term 1.
12:12:31.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.597918 12758 leader_election.cc:304] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aeee9093f324ddcb4adc4ff322e3a04, 8ac0e49cb3374fe69587da31db9ad3da; no voters: 
12:12:31.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.598507 12993 raft_consensus.cc:2804] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 1 FOLLOWER]: Leader election won for term 1
12:12:31.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.600046 12993 raft_consensus.cc:697] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [term 1 LEADER]: Becoming Leader. State: Replica: 7aeee9093f324ddcb4adc4ff322e3a04, State: Running, Role: LEADER
12:12:31.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.600843 12993 consensus_queue.cc:237] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } }
12:12:31.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.611290 12265 catalog_manager.cc:5697] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3). New cstate: current_term: 1 leader_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } health_report { overall_health: UNKNOWN } } }
12:12:31.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.619045 12586 tablet.cc:2406] T 22a5495a66ce4a0b99bd3319144b24a3 P 5ab7ea72bb054c89adbb75260eb20139: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:31.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.620085 12877 tablet.cc:2406] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:31.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.714043 12265 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33254:
12:12:31.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
12:12:31.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.733623 12265 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87ae954446a54eb480d547d5c47129ca has no consensus state
12:12:31.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:31.765780 12253 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 87ae954446a54eb480d547d5c47129ca (table replication_test_table [id=59069c7e42134cdfa39c72c17621f073], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 87ae954446a54eb480d547d5c47129ca consensus state has no leader
12:12:31.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.765503 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 87ae954446a54eb480d547d5c47129ca (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:31.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.766645 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ae954446a54eb480d547d5c47129ca. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.766386 12517 tablet_service.cc:1511] Processing CreateTablet for tablet 87ae954446a54eb480d547d5c47129ca (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:31.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.767444 12517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ae954446a54eb480d547d5c47129ca. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.768740 12805 tablet_service.cc:1511] Processing CreateTablet for tablet 87ae954446a54eb480d547d5c47129ca (DEFAULT_TABLE table=replication_test_table [id=59069c7e42134cdfa39c72c17621f073]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:12:31.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.769594 12805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ae954446a54eb480d547d5c47129ca. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:31.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.780612 12986 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139: Bootstrap starting.
12:12:31.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.784847 12987 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04: Bootstrap starting.
12:12:31.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.785128 12986 tablet_bootstrap.cc:654] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139: Neither blocks nor log segments found. Creating new log.
12:12:31.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.790833 12987 tablet_bootstrap.cc:654] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04: Neither blocks nor log segments found. Creating new log.
12:12:31.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.799335 12986 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139: No bootstrap required, opened a new log
12:12:31.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.799785 12986 ts_tablet_manager.cc:1403] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.001s
12:12:31.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.801234 12984 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da: Bootstrap starting.
12:12:31.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.804163 12987 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04: No bootstrap required, opened a new log
12:12:31.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.804751 12987 ts_tablet_manager.cc:1403] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
12:12:31.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.807075 12984 tablet_bootstrap.cc:654] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da: Neither blocks nor log segments found. Creating new log.
12:12:31.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.807538 12987 raft_consensus.cc:359] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.808451 12987 raft_consensus.cc:385] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.808876 12987 raft_consensus.cc:740] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aeee9093f324ddcb4adc4ff322e3a04, State: Initialized, Role: FOLLOWER
12:12:31.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.809693 12987 consensus_queue.cc:260] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.811781 12987 ts_tablet_manager.cc:1434] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
12:12:31.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.813997 12986 raft_consensus.cc:359] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.814646 12986 raft_consensus.cc:385] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.814893 12986 raft_consensus.cc:740] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab7ea72bb054c89adbb75260eb20139, State: Initialized, Role: FOLLOWER
12:12:31.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.815519 12986 consensus_queue.cc:260] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.822239 12986 ts_tablet_manager.cc:1434] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
12:12:31.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.833206 12984 tablet_bootstrap.cc:492] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da: No bootstrap required, opened a new log
12:12:31.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.833628 12984 ts_tablet_manager.cc:1403] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.006s
12:12:31.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.836205 12984 raft_consensus.cc:359] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.836870 12984 raft_consensus.cc:385] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:31.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.837126 12984 raft_consensus.cc:740] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac0e49cb3374fe69587da31db9ad3da, State: Initialized, Role: FOLLOWER
12:12:31.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.837759 12984 consensus_queue.cc:260] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.843485 12984 ts_tablet_manager.cc:1434] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
12:12:31.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.857890 12265 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 129656c699a04c5f8fcce84a60c0f07d: replication_test_table [id=59069c7e42134cdfa39c72c17621f073] alter complete (version 0)
12:12:31.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.879225 12992 raft_consensus.cc:493] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:31.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.879637 12992 raft_consensus.cc:515] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.882246 12992 leader_election.cc:290] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199), 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3:44361)
12:12:31.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.894248 12825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ae954446a54eb480d547d5c47129ca" candidate_uuid: "5ab7ea72bb054c89adbb75260eb20139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" is_pre_election: true
12:12:31.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.894994 12825 raft_consensus.cc:2468] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ab7ea72bb054c89adbb75260eb20139 in term 0.
12:12:31.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.896262 12473 leader_election.cc:304] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ab7ea72bb054c89adbb75260eb20139, 7aeee9093f324ddcb4adc4ff322e3a04; no voters: 
12:12:31.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.896764 12685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ae954446a54eb480d547d5c47129ca" candidate_uuid: "5ab7ea72bb054c89adbb75260eb20139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac0e49cb3374fe69587da31db9ad3da" is_pre_election: true
12:12:31.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.897058 12992 raft_consensus.cc:2804] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:31.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.897284 12685 raft_consensus.cc:2468] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ab7ea72bb054c89adbb75260eb20139 in term 0.
12:12:31.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.897344 12992 raft_consensus.cc:493] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:31.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.897636 12992 raft_consensus.cc:3060] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 0 FOLLOWER]: Advancing to term 1
12:12:31.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.902138 12992 raft_consensus.cc:515] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.903683 12992 leader_election.cc:290] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [CANDIDATE]: Term 1 election: Requested vote from peers 8ac0e49cb3374fe69587da31db9ad3da (127.11.220.2:40199), 7aeee9093f324ddcb4adc4ff322e3a04 (127.11.220.3:44361)
12:12:31.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.904546 12685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ae954446a54eb480d547d5c47129ca" candidate_uuid: "5ab7ea72bb054c89adbb75260eb20139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ac0e49cb3374fe69587da31db9ad3da"
12:12:31.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.904676 12825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ae954446a54eb480d547d5c47129ca" candidate_uuid: "5ab7ea72bb054c89adbb75260eb20139" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aeee9093f324ddcb4adc4ff322e3a04"
12:12:31.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.905058 12685 raft_consensus.cc:3060] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 0 FOLLOWER]: Advancing to term 1
12:12:31.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.905238 12825 raft_consensus.cc:3060] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 0 FOLLOWER]: Advancing to term 1
12:12:31.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.909824 12685 raft_consensus.cc:2468] T 87ae954446a54eb480d547d5c47129ca P 8ac0e49cb3374fe69587da31db9ad3da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ab7ea72bb054c89adbb75260eb20139 in term 1.
12:12:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.910813 12470 leader_election.cc:304] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ab7ea72bb054c89adbb75260eb20139, 8ac0e49cb3374fe69587da31db9ad3da; no voters: 
12:12:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.911412 12992 raft_consensus.cc:2804] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 1 FOLLOWER]: Leader election won for term 1
12:12:31.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.911428 12825 raft_consensus.cc:2468] T 87ae954446a54eb480d547d5c47129ca P 7aeee9093f324ddcb4adc4ff322e3a04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ab7ea72bb054c89adbb75260eb20139 in term 1.
12:12:31.920 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state READY
12:12:31.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.920055 12992 raft_consensus.cc:697] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [term 1 LEADER]: Becoming Leader. State: Replica: 5ab7ea72bb054c89adbb75260eb20139, State: Running, Role: LEADER
12:12:31.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.921003 12992 consensus_queue.cc:237] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } }
12:12:31.922 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state READY
12:12:31.922 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state READY
12:12:31.926 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.38.62:34839(127.11.38.62:34839)] handling channelInactive
12:12:31.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state READY due to: connection closed
12:12:31.927 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.38.61:36393(127.11.38.61:36393)] handling channelInactive
12:12:31.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state READY due to: connection closed
12:12:31.927 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:31.929 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:12:31.934 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:12:31.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:31.936107 12265 catalog_manager.cc:5697] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ab7ea72bb054c89adbb75260eb20139 (127.11.220.1). New cstate: current_term: 1 leader_uuid: "5ab7ea72bb054c89adbb75260eb20139" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 } health_report { overall_health: UNKNOWN } } }
12:12:31.937 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.38.60:33275(127.11.38.60:33275)] handling channelInactive
12:12:31.937 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state READY due to: connection closed
12:12:31.938 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:12:31.938 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state READY
12:12:31.939 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state READY
12:12:31.939 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state READY
12:12:31.940 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:31.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:31.941 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:31.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:31.941 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:31.946 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:12:31.950 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:12:31.956 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:31.956 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:31.956 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:12:32.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:32.129686 12993 consensus_queue.cc:1048] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:32.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:32.178560 12993 consensus_queue.cc:1048] T 22a5495a66ce4a0b99bd3319144b24a3 P 7aeee9093f324ddcb4adc4ff322e3a04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab7ea72bb054c89adbb75260eb20139" member_type: VOTER last_known_addr { host: "127.11.220.1" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:32.221 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:12:32.224 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:12:32.224 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:12:32.224 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:12:32.224 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:12:32.228 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:12:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:32.432227 12992 consensus_queue.cc:1048] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ac0e49cb3374fe69587da31db9ad3da" member_type: VOTER last_known_addr { host: "127.11.220.2" port: 40199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:12:32.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:32.483448 13032 consensus_queue.cc:1048] T 87ae954446a54eb480d547d5c47129ca P 5ab7ea72bb054c89adbb75260eb20139 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aeee9093f324ddcb4adc4ff322e3a04" member_type: VOTER last_known_addr { host: "127.11.220.3" port: 44361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:12:32.517 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:12:32.517 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:12:32.517 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:12:32.518 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:12:32.518 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:12:32.519 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:12:32.521 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:12:32.768 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:12:32.859 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:12:32.859 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:12:32.859 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:12:32.875 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:12:33.582 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:12:33.721 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:12:33.745 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:12:33.783 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:12:33.800 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:12:33.821 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:12:33.933 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:12:33.938 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:12:33.938 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:12:33.946 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:12:33.947 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:12:33.949 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:12:33.949 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:12:33.950 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:12:33.952 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:12:33.953 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:12:33.954 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:12:33.955 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:12:33.955 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:12:33.955 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:12:33.955 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:12:33.956 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:12:33.958 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:12:33.959 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:12:33.959 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:12:33.959 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:12:33.960 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:12:33.960 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:12:33.960 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:12:33.960 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:12:33.975 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_6f1157c8fc1233049c95b8d3bf846da3/blobStorage
12:12:33.982 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:43583 - max concurrent requests: 50 - max backlog: 1000
12:12:33.990 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6f1157c8fc1233049c95b8d3bf846da3/blobStorage
12:12:33.993 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6f1157c8fc1233049c95b8d3bf846da3/blobStorage
12:12:33.995 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:12:34.000 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: acb06fe1-d887-4b4f-977e-ab286ef66b41
12:12:34.022 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:12:34.025 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-a5604d1a-6b98-41b1-8826-6bd79cb2b90b
12:12:34.037 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-ad90b573-6f5c-4f5f-a543-703c642bc4af
12:12:34.121 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:12:34.139 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:12:34.139 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:12:34.140 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:12:34.178 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:12:34.193 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_0 .
12:12:34.248 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
12:12:34.250 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-a33bdb71-61aa-4252-9214-f82a29b41fae
12:12:34.317 [INFO - main] (RestServerEndpoint.java:567) Upload directory /tmp/flink-web-upload does not exist. 
12:12:34.317 [INFO - main] (RestServerEndpoint.java:592) Created directory /tmp/flink-web-upload for file uploads.
12:12:34.321 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:12:34.324 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:12:34.669 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:12:34.669 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:12:34.820 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:39031
12:12:34.821 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:12:34.833 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:39031 was granted leadership with leaderSessionID=9756c8e0-01dc-4417-b738-014ccb96ed2c
12:12:34.833 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:39031 , session=9756c8e0-01dc-4417-b738-014ccb96ed2c
12:12:34.846 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:12:34.846 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:12:34.846 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:12:34.847 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id eccbd8a9-9a00-4cee-bb4d-12ab6fc72398. Creating new DispatcherLeaderProcess.
12:12:34.850 [INFO - pool-11-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 55d2e4e9-cca3-4e47-b1ed-ce1243fc188a.
12:12:34.851 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:12:34.852 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:12:34.855 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:12:34.855 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:12:34.878 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_1 .
12:12:34.893 [INFO - pool-11-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_2 .
12:12:34.913 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
12:12:34.917 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:12:34.918 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:12:34.919 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:12:34.919 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:12:34.919 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_2 , session=55d2e4e9-cca3-4e47-b1ed-ce1243fc188a
12:12:34.921 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_1 , session=eccbd8a9-9a00-4cee-bb4d-12ab6fc72398
12:12:34.922 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(b1edce1243fc188a55d2e4e9cca34e47).
12:12:34.959 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:12:34.984 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (6b98bc975be284725b662aff85b5faa8).
12:12:34.986 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (6b98bc975be284725b662aff85b5faa8).
12:12:34.995 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID acb06fe1-d887-4b4f-977e-ab286ef66b41 (pekko://flink/user/rpc/taskmanager_0) at ResourceManager
12:12:34.997 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_2 under registration id a7ee95385eb742798cca1b0922bae6d2.
12:12:34.999 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor acb06fe1-d887-4b4f-977e-ab286ef66b41 under a7ee95385eb742798cca1b0922bae6d2 at the slot manager.
12:12:35.010 [INFO - flink-pekko.actor.default-dispatcher-4] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-6b98bc975be284725b662aff85b5faa8'.
12:12:35.012 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 6b98bc975be284725b662aff85b5faa8 was granted leadership with leader id e7e7cbe3-ca94-4f8a-b3da-2c7fe2d2d3ab. Creating new JobMasterServiceProcess.
12:12:35.024 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 .
12:12:35.034 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (6b98bc975be284725b662aff85b5faa8).
12:12:35.072 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (6b98bc975be284725b662aff85b5faa8).
12:12:35.123 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph f1df39072930eae44b7713aa4c84107c for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.153 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8).
12:12:35.154 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:12:35.193 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 2 ms, total 4 pipelined regions currently.
12:12:35.202 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@178d2a79
12:12:35.202 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:12:35.204 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:12:35.270 [INFO - jobmanager-io-thread-1] (FileSystem.java:1139) Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
12:12:35.307 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:12:35.318 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@38bc73f9 for Flink Streaming Job (6b98bc975be284725b662aff85b5faa8).
12:12:35.333 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_3 , session=e7e7cbe3-ca94-4f8a-b3da-2c7fe2d2d3ab
12:12:35.337 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (6b98bc975be284725b662aff85b5faa8) under job master id b3da2c7fe2d2d3abe7e7cbe3ca944f8a.
12:12:35.343 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:12:35.349 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:35.352 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:12:35.352 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state CREATED to RUNNING.
12:12:35.361 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:12:35.362 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:35.363 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:35.364 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.38.61:36393(127.11.38.61:36393)] Successfully connected to peer
12:12:35.378 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.61
12:12:35.381 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:35.390 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.38.60:33275(127.11.38.60:33275)] Successfully connected to peer
12:12:35.409 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.413 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.38.62:34839(127.11.38.62:34839)] Successfully connected to peer
12:12:35.417 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.62
12:12:35.421 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.60
12:12:35.426 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfc1b7a3b, L:/127.0.0.1:42168 - R:/127.11.38.61:36393] using SASL/PLAIN
12:12:35.437 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:35.437 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=76), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [75ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: OK, deferred=null) after lookup
12:12:35.443 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.445 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:12:35.445 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:35.451 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.452 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:35.452 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:35.452 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:35.452 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:12:35.453 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:12:35.454 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_2(b1edce1243fc188a55d2e4e9cca34e47)
12:12:35.459 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:12:35.460 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager b3da2c7fe2d2d3abe7e7cbe3ca944f8a@pekko://flink/user/rpc/jobmanager_3 for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.470 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xf8eff3bd, L:/127.0.0.1:60848 - R:/127.11.38.62:34839] using SASL/PLAIN
12:12:35.471 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa1e32dc1, L:/127.0.0.1:44400 - R:/127.11.38.60:33275] using SASL/PLAIN
12:12:35.486 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager b3da2c7fe2d2d3abe7e7cbe3ca944f8a@pekko://flink/user/rpc/jobmanager_3 for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.488 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:35.490 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b1edce1243fc188a55d2e4e9cca34e47.
12:12:35.492 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:12:35.494 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:35.497 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:35.499 [DEBUG - main] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:35.502 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:35.506 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:35.512 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:35.515 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:35.526 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:35.528 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.534 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.535 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8ef36ab6, L:/127.0.0.1:33270 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:35.540 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:35.540 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=60), Traces: [0ms] refreshing cache from master, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [59ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:35.544 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x855ab87f, L:/127.0.0.1:33942 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:35.546 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:35.552 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.555 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5093b00b, L:/127.0.0.1:48258 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:35.560 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 6b98bc975be284725b662aff85b5faa8
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager acb06fe1-d887-4b4f-977e-ab286ef66b41
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:12:35.565 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 22a5495a66ce4a0b99bd3319144b24a3 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:35.565 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:35.566 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=22a5495a66ce4a0b99bd3319144b24a3@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891),7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)[L],8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:35.568 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 51eedb814078aca1d10de66e4d8aafa4 from acb06fe1-d887-4b4f-977e-ab286ef66b41 for job 6b98bc975be284725b662aff85b5faa8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.571 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 51eedb814078aca1d10de66e4d8aafa4 for job 6b98bc975be284725b662aff85b5faa8 from resource manager with leader id b1edce1243fc188a55d2e4e9cca34e47.
12:12:35.572 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 51eedb814078aca1d10de66e4d8aafa4 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.220.61:39401, [5ms] Sub RPC GetTableLocations: received response from server master-127.11.220.61:39401: OK, deferred=null)) after lookup
12:12:35.581 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 154b74b5f9dbb0c714a11fccfe184c75 from acb06fe1-d887-4b4f-977e-ab286ef66b41 for job 6b98bc975be284725b662aff85b5faa8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.582 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot dbd00510a04dbb00458d20e911a1c6ac from acb06fe1-d887-4b4f-977e-ab286ef66b41 for job 6b98bc975be284725b662aff85b5faa8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.583 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot f6cd9ce344feec383d8c503432ef47a2 from acb06fe1-d887-4b4f-977e-ab286ef66b41 for job 6b98bc975be284725b662aff85b5faa8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.584 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] connecting to peer
12:12:35.585 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 6b98bc975be284725b662aff85b5faa8 for job leader monitoring.
12:12:35.587 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_3 with leader id e7e7cbe3-ca94-4f8a-b3da-2c7fe2d2d3ab.
12:12:35.587 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 154b74b5f9dbb0c714a11fccfe184c75 for job 6b98bc975be284725b662aff85b5faa8 from resource manager with leader id b1edce1243fc188a55d2e4e9cca34e47.
12:12:35.588 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 154b74b5f9dbb0c714a11fccfe184c75 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.588 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request dbd00510a04dbb00458d20e911a1c6ac for job 6b98bc975be284725b662aff85b5faa8 from resource manager with leader id b1edce1243fc188a55d2e4e9cca34e47.
12:12:35.589 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for dbd00510a04dbb00458d20e911a1c6ac with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.589 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:12:35.590 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request f6cd9ce344feec383d8c503432ef47a2 for job 6b98bc975be284725b662aff85b5faa8 from resource manager with leader id b1edce1243fc188a55d2e4e9cca34e47.
12:12:35.590 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] Successfully connected to peer
12:12:35.590 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for f6cd9ce344feec383d8c503432ef47a2 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:12:35.594 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_3 for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.595 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1783) Establish JobManager connection for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.598 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 6b98bc975be284725b662aff85b5faa8.
12:12:35.607 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:12:35.609 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.607 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:12:35.616 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xd6d479ff, L:/127.0.0.1:49184 - R:/127.11.220.3:44361] using TOKEN/null
12:12:35.633 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:12:35.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:12:35.634 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:12:35.656 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:12:35.656 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:12:35.658 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 6b98bc975be284725b662aff85b5faa8.
12:12:35.663 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:84) StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
12:12:35.663 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:12:35.666 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:12:35.667 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:12:35.668 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.669 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:35.670 [DEBUG - main] (Connection.java:748) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] connecting to peer
12:12:35.679 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 6b98bc975be284725b662aff85b5faa8
12:12:35.682 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] Successfully connected to peer
12:12:35.706 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:12:35.715 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:35.723 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xbaac3171, L:/127.0.0.1:35664 - R:/127.11.220.1:40891] using TOKEN/null
12:12:35.732 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.733 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:35.741 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:12:35.747 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:12:35.747 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:12:35.777 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:12:35.789 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:12:35.789 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:12:35.793 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.796 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:35.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:12:35.803 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.803 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:35.810 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:12:35.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:12:35.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:12:35.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:12:35.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:12:35.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:12:35.837 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:12:35.841 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:12:35.842 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:12:35.843 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:12:35.844 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:12:35.844 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:12:35.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.869 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:35.876 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.879 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:35.881 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@358aa1c8
12:12:35.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:12:35.882 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:12:35.883 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b4f6a96
12:12:35.883 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:12:35.883 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:12:35.884 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4155eb20
12:12:35.884 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:12:35.884 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:12:35.885 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@589cb4a1
12:12:35.885 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:12:35.885 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:12:35.895 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:12:35.897 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:12:35.911 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:12:35.911 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:12:35.916 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:12:35.916 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:12:35.928 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:12:35.929 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:12:35.938 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.938 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:35.946 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:35.946 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.005 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.016 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.016 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.064 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e1cecc4
12:12:36.064 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2bc50d
12:12:36.065 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69edf52f
12:12:36.066 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ba85237
12:12:36.075 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.076 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.091 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.092 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.142 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.145 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.145 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.146 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.150 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.150 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.155 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:36.157 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.158 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.171 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:36.176 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:36.191 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:12:36.201 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:36.209 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:36.216 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.218 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:36.221 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:36.225 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.236 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.247 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:36.251 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:12:36.255 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:36.263 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:36.271 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:36.287 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:36.291 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:36.292 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:36.294 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:36.311 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:36.312 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.312 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.320 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.320 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.329 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:36.349 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:36.352 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.356 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x35b50435, L:/127.0.0.1:48260 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:36.358 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:36.365 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:36.370 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:36.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.378 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.393 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.393 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.405 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.411 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:36.413 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:36.419 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.435 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa53f3957, L:/127.0.0.1:33282 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:36.443 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:36.444 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=300), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [133ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: OK, [289ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:36.451 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.452 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.456 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:36.458 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:36.473 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:36.482 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:12:36.483 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.484 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.493 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.495 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:36.496 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.510 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb1242635, L:/127.0.0.1:33296 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:36.515 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.220.61:39401(127.11.220.61:39401)] Successfully connected to peer
12:12:36.518 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.525 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc2b170ca, L:/127.0.0.1:33962 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:36.526 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.532 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:36.532 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=386), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [361ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:36.526 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.61
12:12:36.533 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1d440b6b, L:/127.0.0.1:33302 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:36.541 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.541 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.548 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.548 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.549 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:36.550 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=403), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [359ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:36.550 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.551 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:12:36.553 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.220.62:34269(127.11.220.62:34269)] Successfully connected to peer
12:12:36.561 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.565 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.565 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17a20fa3
12:12:36.576 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x90fad367, L:/127.0.0.1:33946 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:36.579 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.579 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27fd4b16
12:12:36.586 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:12:36.592 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:12:36.609 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.609 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.616 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.617 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.620 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.62
12:12:36.625 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.630 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd0611e65, L:/127.0.0.1:48268 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:36.636 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.220.60:40605(127.11.220.60:40605)] Successfully connected to peer
12:12:36.645 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.220.60
12:12:36.650 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:12:36.650 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:12:36.653 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.657 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.657 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e1915ad
12:12:36.658 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:12:36.660 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:12:36.663 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.667 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:12:36.669 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8f9fd9364dd262dbbe8ef64a9e1054eb758b8494f55b418ebd37326066142cd2'}]
12:12:36.673 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.683 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x016153a3, L:/127.0.0.1:33314 - R:/127.11.220.61:39401] using SASL/PLAIN
12:12:36.685 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.685 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.687 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.692 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x548ccd81, L:/127.0.0.1:33978 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:36.693 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:36.693 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=547), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [376ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [517ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: OK, deferred=null) after lookup
12:12:36.697 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x83169f1a, L:/127.0.0.1:48272 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:36.699 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.703 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:12:36.710 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xff275b93, L:/127.0.0.1:33982 - R:/127.11.220.62:34269] using SASL/PLAIN
12:12:36.715 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.718 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:36.718 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ce7243f
12:12:36.721 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:12:36.721 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:12:36.721 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc09a0086, L:/127.0.0.1:48280 - R:/127.11.220.60:40605] using SASL/PLAIN
12:12:36.724 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:12:36.727 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:12:36.733 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:12:36.737 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299997, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}]
12:12:36.737 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f4c6cf728b1c28051b8a5d22bca937651f1912478e20c9ed279ed5dfc058c997'}]
12:12:36.740 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:36.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.751 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:12:36.754 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.754 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.766 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] connecting to peer
12:12:36.774 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:12:36.775 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299997, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}]
12:12:36.805 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] Successfully connected to peer
12:12:36.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.820 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.821 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:12:36.827 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.827 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.833 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:12:36.834 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:12:36.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (3/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:12:36.842 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.1
12:12:36.843 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] connecting to peer
12:12:36.854 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] Successfully connected to peer
12:12:36.863 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:36.877 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.1
12:12:36.882 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe18e943a, L:/127.0.0.1:41462 - R:/127.11.38.1:37833] using SASL/PLAIN
12:12:36.886 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.886 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.898 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.898 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.960 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305268245954560001) for scanner KuduScanner(table=replication_test_table, tablet=c50567019d32463bbb9d67af32b8657e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.963 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [8f9fd9364dd262dbbe8ef64a9e1054eb758b8494f55b418ebd37326066142cd2]
12:12:36.963 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:36.966 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:12:36.971 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:36.971 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:36.988 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:37.008 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe95bef01, L:/127.0.0.1:41476 - R:/127.11.38.1:37833] using SASL/PLAIN
12:12:37.033 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.034 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.041 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.041 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false, responseScanTimestamp = 7305268245954560001) for scanner KuduScanner(table=replication_test_table, tablet=c01bbfc489f7433982240298de513cdd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.041 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.042 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [f4c6cf728b1c28051b8a5d22bca937651f1912478e20c9ed279ed5dfc058c997]
12:12:37.042 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:12:37.104 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.105 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.118 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.118 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.162 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.162 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.163 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 22a5495a66ce4a0b99bd3319144b24a3 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.163 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.164 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=22a5495a66ce4a0b99bd3319144b24a3@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891),7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)[L],8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.165 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f4c6cf728b1c28051b8a5d22bca937651f1912478e20c9ed279ed5dfc058c997]
12:12:37.167 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 22a5495a66ce4a0b99bd3319144b24a3 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.168 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.168 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=22a5495a66ce4a0b99bd3319144b24a3@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891),7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)[L],8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.171 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.171 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.173 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8f9fd9364dd262dbbe8ef64a9e1054eb758b8494f55b418ebd37326066142cd2]
12:12:37.177 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.178 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.181 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f4c6cf728b1c28051b8a5d22bca937651f1912478e20c9ed279ed5dfc058c997 finished by subtask 3; deferring removal (restored in pending)
12:12:37.183 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8f9fd9364dd262dbbe8ef64a9e1054eb758b8494f55b418ebd37326066142cd2 finished by subtask 0; deferring removal (restored in pending)
12:12:37.184 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:12:37.184 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:12:37.184 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] disconnecting while in state READY
12:12:37.185 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:37.192 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.193 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.194 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:12:37.194 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:12:37.194 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] disconnecting while in state READY
12:12:37.195 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:37.225 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:12:37.226 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] handling channelInactive
12:12:37.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] cleaning up while in state READY due to: connection closed
12:12:37.226 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:12:37.256 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.257 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.258 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] handling channelInactive
12:12:37.258 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] cleaning up while in state READY due to: connection closed
12:12:37.259 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:12:37.259 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:12:37.273 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.273 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.276 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512757249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:37.304 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=325, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4650e875, flushNotification=Deferred@552411465(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:12:37.308 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] connecting to peer
12:12:37.324 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] Successfully connected to peer
12:12:37.333 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=5, operationSize=315, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@572e7f2a, flushNotification=Deferred@1252425272(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:12:37.335 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.336 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.338 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] connecting to peer
12:12:37.358 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] Successfully connected to peer
12:12:37.376 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.376 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.402 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:37.431 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:37.434 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.435 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.441 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.441 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.447 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x275215a6, L:/127.0.0.1:35678 - R:/127.11.220.1:40891] using TOKEN/null
12:12:37.450 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xcdb3d84a, L:/127.0.0.1:49200 - R:/127.11.220.3:44361] using TOKEN/null
12:12:37.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:37.462790 11986 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2520 after lost signal to thread 11860
12:12:37.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:37.463846 11986 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad4c0 after lost signal to thread 11989
12:12:37.505 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.505 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.523 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.524 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.620 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.620 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.632 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.633 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.678 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 6b98bc975be284725b662aff85b5faa8 (2232 bytes, checkpointDuration=405 ms, finalizationTime=24 ms).
12:12:37.695 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.696 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.705 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.706 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.711 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:37.716 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:37.720 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:37.723 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:37.726 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:12:37.727 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split f4c6cf728b1c28051b8a5d22bca937651f1912478e20c9ed279ed5dfc058c997 from pending
12:12:37.727 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 8f9fd9364dd262dbbe8ef64a9e1054eb758b8494f55b418ebd37326066142cd2 from pending
12:12:37.728 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 2 finished splits from enumerator state
12:12:37.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.731 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.732 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.738 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 22a5495a66ce4a0b99bd3319144b24a3 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.738 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.738 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=22a5495a66ce4a0b99bd3319144b24a3@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891),7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)[L],8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.742 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:37.746 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 59069c7e42134cdfa39c72c17621f073
12:12:37.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512757749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:37.752 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.752 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.753 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.753 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.38.61:36393, [5ms] Sub RPC GetTableLocations: received response from server master-127.11.38.61:36393: OK, deferred=null)) after lookup
12:12:37.778 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=23 ms, finalizationTime=6 ms).
12:12:37.780 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:12:37.789 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c01bbfc489f7433982240298de513cdd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.790 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c01bbfc489f7433982240298de513cdd for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.799 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c50567019d32463bbb9d67af32b8657e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.799 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c50567019d32463bbb9d67af32b8657e for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.804 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 22a5495a66ce4a0b99bd3319144b24a3 for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:37.804 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 87ae954446a54eb480d547d5c47129ca for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:37.804 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=22a5495a66ce4a0b99bd3319144b24a3@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891),7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)[L],8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=87ae954446a54eb480d547d5c47129ca@[5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)[L],7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361),8ac0e49cb3374fe69587da31db9ad3da(127.11.220.2:40199)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:37.805 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.220.61:39401, [3ms] Sub RPC GetTableLocations: received response from server master-127.11.220.61:39401: OK, deferred=null)) after lookup
12:12:37.813 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.814 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.822 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.823 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.842 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c01bbfc489f7433982240298de513cdd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.843 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet c01bbfc489f7433982240298de513cdd for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=c50567019d32463bbb9d67af32b8657e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.857 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet c50567019d32463bbb9d67af32b8657e for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.868 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=22a5495a66ce4a0b99bd3319144b24a3, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.869 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 22a5495a66ce4a0b99bd3319144b24a3 for partition [0x80000000, 0x80000032) with scanner id null
12:12:37.880 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 5 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=87ae954446a54eb480d547d5c47129ca, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:37.892 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 87ae954446a54eb480d547d5c47129ca for partition [0x80000064, 0x800000C8) with scanner id null
12:12:37.893 [DEBUG - main] (Connection.java:575) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] disconnecting while in state READY
12:12:37.893 [DEBUG - main] (Connection.java:575) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] disconnecting while in state READY
12:12:37.893 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state READY
12:12:37.894 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state READY
12:12:37.894 [DEBUG - main] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state READY
12:12:37.895 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] handling channelInactive
12:12:37.895 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:37.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] cleaning up while in state READY due to: connection closed
12:12:37.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:37.896 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:37.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:37.898 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:37.898 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:37.899 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:37.900 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:12:37.901 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:12:37.901 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:12:37.902 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
12:12:37.912 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] handling channelInactive
12:12:37.913 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] cleaning up while in state READY due to: connection closed
12:12:37.913 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
12:12:37.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:37.915767 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12447
12:12:37.972 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] handling channelInactive
12:12:37.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] cleaning up while in state READY due to: connection closed
12:12:37.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:37.981365 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12591
12:12:38.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:38.024549 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12741
12:12:38.066 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] handling channelInactive
12:12:38.066 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] cleaning up while in state READY due to: connection closed
12:12:38.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:38.067459 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12157
12:12:38.134 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:38.134 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:38.134 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:38.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:38.135 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:38.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:38.136 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.220.62:34269(127.11.220.62:34269)] handling channelInactive
12:12:38.136 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state READY due to: connection closed
12:12:38.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:38.136397 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12227
12:12:38.171 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:38.171 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:38.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:38.172 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:38.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:38.173 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.220.61:39401(127.11.220.61:39401)] handling channelInactive
12:12:38.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:38.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state READY due to: connection closed
12:12:38.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:38.176730 12144 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12303
12:12:38.214 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:38.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:38.218 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:38.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:38.218 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:38.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:38.219 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.220.60:40605(127.11.220.60:40605)] handling channelInactive
12:12:38.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state READY due to: connection closed
12:12:38.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512758249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:38.281 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=31 ms, finalizationTime=1 ms).
12:12:38.283 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:12:38.751 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512758749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:38.781 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=31 ms, finalizationTime=0 ms).
12:12:38.783 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:12:39.251 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512759249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:39.278 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=28 ms, finalizationTime=1 ms).
12:12:39.279 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:12:39.367 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 98275711d6cc4f8a86d5f78c3f787705
12:12:39.372 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c01bbfc489f7433982240298de513cdd for table 'replication_test_table' with partition [0x80000000, 0x80000032)
12:12:39.373 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet c50567019d32463bbb9d67af32b8657e for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:12:39.373 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299999, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x80000032, upperBoundPartitionKey=0x80000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}, NonCoveredRange{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:12:39.376 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d96dd6c3e64e634eb0bd4825a63f38631c449f8f200a8037cd72b8d5836be40a'}]
12:12:39.378 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:39.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='920b0e97eac9c08f24b3da22286246f74e273c1013232040d0e82d6bc0526440'}]
12:12:39.382 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:39.397 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:12:39.399 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=c50567019d32463bbb9d67af32b8657e@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)[L],6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311),8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}]
12:12:39.410 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:12:39.411 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000000, upperBoundPartitionKey=0x80000032, ttl=299998, tablet=c01bbfc489f7433982240298de513cdd@[1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833),6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)[L],8ed87f31e9c14b1f9d38ececa4c6fe5e(127.11.38.3:39999)]}]
12:12:39.418 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] connecting to peer
12:12:39.426 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] connecting to peer
12:12:39.432 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] Successfully connected to peer
12:12:39.436 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] Successfully connected to peer
12:12:39.465 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.1
12:12:39.475 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.38.1
12:12:39.514 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:39.534 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:12:39.552 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xedd8cd61, L:/127.0.0.1:42434 - R:/127.11.38.1:37833] using SASL/PLAIN
12:12:39.553 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3a7abe21, L:/127.0.0.1:42428 - R:/127.11.38.1:37833] using SASL/PLAIN
12:12:39.570 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268262338560001) for scanner KuduScanner(table=replication_test_table, tablet=c01bbfc489f7433982240298de513cdd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:39.571 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [d96dd6c3e64e634eb0bd4825a63f38631c449f8f200a8037cd72b8d5836be40a]
12:12:39.571 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d96dd6c3e64e634eb0bd4825a63f38631c449f8f200a8037cd72b8d5836be40a]
12:12:39.571 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:12:39.571 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:12:39.572 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d96dd6c3e64e634eb0bd4825a63f38631c449f8f200a8037cd72b8d5836be40a finished by subtask 1; deferring removal (restored in pending)
12:12:39.573 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] disconnecting while in state READY
12:12:39.574 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:39.576 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268262338560001) for scanner KuduScanner(table=replication_test_table, tablet=c50567019d32463bbb9d67af32b8657e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:39.576 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [920b0e97eac9c08f24b3da22286246f74e273c1013232040d0e82d6bc0526440]
12:12:39.576 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [920b0e97eac9c08f24b3da22286246f74e273c1013232040d0e82d6bc0526440]
12:12:39.577 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:12:39.577 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:12:39.577 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] disconnecting while in state READY
12:12:39.578 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:39.588 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 920b0e97eac9c08f24b3da22286246f74e273c1013232040d0e82d6bc0526440 finished by subtask 2; deferring removal (restored in pending)
12:12:39.625 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:12:39.625 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] handling channelInactive
12:12:39.625 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] cleaning up while in state READY due to: connection closed
12:12:39.625 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:12:39.655 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] handling channelInactive
12:12:39.655 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] cleaning up while in state READY due to: connection closed
12:12:39.656 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:12:39.656 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:12:39.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512759749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:39.771 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 6b98bc975be284725b662aff85b5faa8 (2252 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
12:12:39.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:12:39.773 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split 920b0e97eac9c08f24b3da22286246f74e273c1013232040d0e82d6bc0526440 from pending
12:12:39.774 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 6 complete: removed split d96dd6c3e64e634eb0bd4825a63f38631c449f8f200a8037cd72b8d5836be40a from pending
12:12:39.774 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 6 complete: removed 2 finished splits from enumerator state
12:12:39.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:39Z chronyd exiting
12:12:40.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512760249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:40.287 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=37 ms, finalizationTime=1 ms).
12:12:40.290 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:12:40.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:40.344018 11523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.38.62:34839, user_credentials={real_user=slave}} blocked reactor thread for 82187.7us
12:12:40.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512760749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:40.777 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=27 ms, finalizationTime=1 ms).
12:12:40.779 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:12:41.043 [DEBUG - main] (Connection.java:575) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] disconnecting while in state READY
12:12:41.043 [DEBUG - main] (Connection.java:575) [peer 6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)] disconnecting while in state READY
12:12:41.044 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state READY
12:12:41.044 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state READY
12:12:41.044 [DEBUG - main] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state READY
12:12:41.044 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)] handling channelInactive
12:12:41.044 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6bfab9f4b9384a25a61717f3e0e74b1b(127.11.38.2:44311)] cleaning up while in state READY due to: connection closed
12:12:41.045 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.38.62:34839(127.11.38.62:34839)] handling channelInactive
12:12:41.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state READY due to: connection closed
12:12:41.045 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.38.60:33275(127.11.38.60:33275)] handling channelInactive
12:12:41.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state READY due to: connection closed
12:12:41.047 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:41.044 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] handling channelInactive
12:12:41.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 1fa64cca4754485089da2caa96ce2824(127.11.38.1:37833)] cleaning up while in state READY due to: connection closed
12:12:41.049 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-1
12:12:41.049 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
12:12:41.050 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
12:12:41.050 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
12:12:41.052 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.38.61:36393(127.11.38.61:36393)] handling channelInactive
12:12:41.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state READY due to: connection closed
12:12:41.053 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-0
12:12:41.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.054062 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 11698
12:12:41.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.099364 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 11856
12:12:41.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.130192 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 12000
12:12:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.152953 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 11428
12:12:41.177 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.38.62:34839(127.11.38.62:34839)] handling channelInactive
12:12:41.177 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state READY due to: connection closed
12:12:41.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.177963 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 11498
12:12:41.204 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.38.61:36393(127.11.38.61:36393)] handling channelInactive
12:12:41.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state READY due to: connection closed
12:12:41.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:41.205466 11416 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 11573
12:12:41.228 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.38.60:33275(127.11.38.60:33275)] handling channelInactive
12:12:41.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state READY due to: connection closed
12:12:41.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512761249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:41.268 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:12:41.269 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:12:41.360 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.363 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.363 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.363 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.11.38.61:36393(127.11.38.61:36393) for tablet Kudu Master: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.382 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.384 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.385 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.385 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.387 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.387 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.390 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.403 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.404 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.405 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.405 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.405 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.405 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.406 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.406 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.406 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.423 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.423 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.426 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.427 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.427 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.427 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.427 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.442 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.443 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.443 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.443 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.443 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.443 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.444 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.444 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.444 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.445 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.462 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.463 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.464 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.465 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.465 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.465 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.502 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.503 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.503 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.503 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.503 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.504 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.504 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.504 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.504 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.505 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.505 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.505 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.505 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.582 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.583 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.584 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.586 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.586 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:41.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512761749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:41.767 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=16 ms, finalizationTime=2 ms).
12:12:41.771 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:12:41.842 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:41.843 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:41.843 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:41.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:41.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:41.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:41.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:42.182 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:42.183 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:42.183 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.183 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.183 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:42.183 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.184 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.184 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.185 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:42.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512762249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:42.261 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:42.262 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:12:42.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:42Z chronyd exiting
12:12:42.662 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:42.663 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:42.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.664 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:42.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.664 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:42.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:42.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:42.665 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:42.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512762749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:42.761 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:42.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:12:43.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512763249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:43.261 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:43.262 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
.12:12:43.343 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512763343
12:12:43.343 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512763343
12:12:43.346 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:12:43.348 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:12:43.349 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:12:43.349 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:12:43.349 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:12:43.349 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:12:43.352 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:12:43.664 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:43.665 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:12:43.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:43.668131 13243 mini_oidc.cc:150] Starting JWKS server
12:12:43.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:43.671146 13243 webserver.cc:533] Webserver started at http://127.0.0.1:38467/ using document root <none> and password file <none>
12:12:43.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:43.671535 13243 mini_oidc.cc:186] Starting OIDC Discovery server
12:12:43.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:43.673115 13243 webserver.cc:533] Webserver started at http://127.0.0.1:34417/ using document root <none> and password file <none>
12:12:43.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:12:43.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:43Z Disabled control of system clock
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:43.731702 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/logs
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data/info.pb
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.254:35497
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.254
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:43.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json with env {}
12:12:43.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512763749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:43.761 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:12:43.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:12:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.028090 13255 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.028730 13255 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.029277 13255 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:44.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.063102 13255 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:44.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.063403 13255 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:44.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.063603 13255 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:44.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.063807 13255 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.063990 13255 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.064137 13255 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38467/jwks.json
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:44.101517 13255 master_runner.cc:387] Master server non-default flags:
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.254:35497
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data/info.pb
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.254
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/logs
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:44.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:44.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:44.102805 13255 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:44.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:44.104331 13255 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:44.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.114952 13261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:44.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512764249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:44.272 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
12:12:44.275 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:12:44.662 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:44.663 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:44.664 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:44.664 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:44.664 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:44.664 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:44.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:44.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:44.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:44.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:44.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:44.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:44.666 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:44.749 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512764748 for job 6b98bc975be284725b662aff85b5faa8.
12:12:44.771 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
12:12:44.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:12:45.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512765249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:45.274 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
12:12:45.275 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:12:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.518216 13260 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 13255
12:12:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:44.115556 13262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:45.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.657958 13255 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.543s	user 0.604s	sys 0.911s
12:12:45.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.660367 13264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:45.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.659690 13255 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.545s	user 0.604s	sys 0.911s
12:12:45.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.662900 13263 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1544 milliseconds
12:12:45.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.662921 13255 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:45.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.664180 13255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:45.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.666478 13255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.667798 13255 hybrid_clock.cc:648] HybridClock initialized: now 1783512765667763 us; error 45 us; skew 500 ppm
12:12:45.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.668584 13255 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:45.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.674209 13255 webserver.cc:533] Webserver started at http://127.12.238.254:42005/ using document root <none> and password file <none>
12:12:45.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.675037 13255 fs_manager.cc:362] Metadata directory not provided
12:12:45.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.675211 13255 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:45.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.675635 13255 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.679898 13255 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data/instance:
12:12:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22e1bf2233db42c3851346de2fb30e9a"
12:12:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:45 on dist-test-slave-vcgh"
12:12:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.680945 13255 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal/instance:
12:12:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22e1bf2233db42c3851346de2fb30e9a"
12:12:45.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:45 on dist-test-slave-vcgh"
12:12:45.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.687927 13255 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
12:12:45.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.695120 13271 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:45.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.696255 13255 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.002s
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.696621 13255 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "22e1bf2233db42c3851346de2fb30e9a"
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:45 on dist-test-slave-vcgh"
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.697014 13255 fs_report.cc:389] FS layout report
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data/data
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:45.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:45.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:45.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:45.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.748651 13255 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:45.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512765749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:45.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.750445 13255 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:45.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.750993 13255 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:45.761 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:45.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:12:45.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.823750 13255 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.254:35497
12:12:45.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.823825 13322 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.254:35497 every 8 connection(s)
12:12:45.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.826471 13255 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/data/info.pb
12:12:45.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.831923 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13255
12:12:45.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.832425 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-0/wal/instance
12:12:45.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.833048 13323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.837265 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/logs
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data/info.pb
12:12:45.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.253:35475
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.253
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:45.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json with env {}
12:12:45.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.846133 13323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
12:12:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.870666 13323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
12:12:45.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.873160 13274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:45.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.877223 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:45.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.926765 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 1
12:12:45.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:45.931499 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:46.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:45.999941 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 2
12:12:46.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.003997 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:46.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.095427 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 3
12:12:46.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.099779 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:46.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.132675 13325 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:46.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.133227 13325 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:46.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.133668 13325 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:46.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.165640 13325 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.165910 13325 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.166100 13325 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.166308 13325 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.166499 13325 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.166644 13325 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38467/jwks.json
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.202210 13325 master_runner.cc:387] Master server non-default flags:
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:46.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.253:35475
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data/info.pb
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.253
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/logs
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.203490 13325 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:46.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.205000 13325 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:46.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.215148 13334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:46.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.243216 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 4
12:12:46.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.247080 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:46.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512766249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:46.261 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:46.262 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:12:46.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:46.546620 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 5
12:12:46.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.550859 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:46.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512766749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:46.761 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:46.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:12:47.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.098351 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 6
12:12:47.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.107900 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.253:35475: Network error: Client connection negotiation failed: client connection to 127.12.238.253:35475: connect: Connection refused (error 111)
12:12:47.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512767249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:47.262 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:12:47.263 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:12:47.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.215693 13335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:47.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:46.218963 13337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:47.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.318342 13336 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
12:12:47.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.318470 13325 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:47.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.321910 13325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:47.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.324311 13325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.325908 13325 hybrid_clock.cc:648] HybridClock initialized: now 1783512767325875 us; error 40 us; skew 500 ppm
12:12:47.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.326685 13325 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:47.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.332654 13325 webserver.cc:533] Webserver started at http://127.12.238.253:45889/ using document root <none> and password file <none>
12:12:47.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.333551 13325 fs_manager.cc:362] Metadata directory not provided
12:12:47.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.333729 13325 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:47.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.334096 13325 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:47.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.338352 13325 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data/instance:
12:12:47.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "845062ce0b554dc9866f2684e1ae11ab"
12:12:47.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:47 on dist-test-slave-vcgh"
12:12:47.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.339659 13325 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal/instance:
12:12:47.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "845062ce0b554dc9866f2684e1ae11ab"
12:12:47.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:47 on dist-test-slave-vcgh"
12:12:47.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.346905 13325 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
12:12:47.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.352394 13347 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:47.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.353457 13325 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.353804 13325 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "845062ce0b554dc9866f2684e1ae11ab"
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:47 on dist-test-slave-vcgh"
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.354130 13325 fs_report.cc:389] FS layout report
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data/data
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:47.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:47.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:47.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:47.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:47.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.401965 13325 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:47.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.403427 13325 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:47.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.403913 13325 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:47.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.471020 13325 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.253:35475
12:12:47.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.471097 13398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.253:35475 every 8 connection(s)
12:12:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.473717 13325 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/data/info.pb
12:12:47.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.479455 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13325
12:12:47.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.479795 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-1/wal/instance
12:12:47.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.480152 13399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:47.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.481663 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/logs
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data/info.pb
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.252:39469
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.252
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json with env {}
12:12:47.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.490638 13399 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
12:12:47.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.514552 13399 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
12:12:47.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.528128 13399 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } has no permanent_uuid. Determining permanent_uuid...
12:12:47.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.530441 13350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:47.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.534516 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:47.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.583978 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 1
12:12:47.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.588074 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:47.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.656422 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 2
12:12:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.660396 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:47.749 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512767748 for job 6b98bc975be284725b662aff85b5faa8.
12:12:47.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.751747 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 3
12:12:47.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.761210 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:47.768 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:12:47.770 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:12:47.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.787853 13401 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:47.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.788403 13401 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:47.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.788911 13401 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.820899 13401 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.821170 13401 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.821386 13401 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.821581 13401 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:47.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.821774 13401 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:47.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.821920 13401 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38467/jwks.json
12:12:47.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.858477 13401 master_runner.cc:387] Master server non-default flags:
12:12:47.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.252:39469
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38467/jwks.json
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data/info.pb
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.252
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/logs
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.859690 13401 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:47.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.861224 13401 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:47.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.871044 13411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:47.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:47.904666 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 4
12:12:47.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.911834 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.168368 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } attempt: 7
12:12:48.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.211308 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 5
12:12:48.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.211966 13323 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } has no permanent_uuid. Determining permanent_uuid...
12:12:48.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.220304 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.237143 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.252 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512768249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:48.271 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=21 ms, finalizationTime=0 ms).
12:12:48.273 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:12:48.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.295611 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 1
12:12:48.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.302405 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.322 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:48.323 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:48.324 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:48.324 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:48.324 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:48.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:48.324 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:48.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:48.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:48.325 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:48.325 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:48.325 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:48.325 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:48.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.383921 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 2
12:12:48.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.390862 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.476313 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 3
12:12:48.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.488236 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.628720 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 4
12:12:48.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.636346 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512768749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:48.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.767741 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 6
12:12:48.773 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
12:12:48.775 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:12:48.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.809674 13399 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:48.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:48.919827 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 5
12:12:48.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:48.926681 13323 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.238.252:39469: Network error: Client connection negotiation failed: client connection to 127.12.238.252:39469: connect: Connection refused (error 111)
12:12:49.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512769249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:49.272 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=22 ms, finalizationTime=1 ms).
12:12:49.275 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.274149 13410 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 13401
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.285015 13410 kernel_stack_watchdog.cc:198] Thread 13401 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.285190 13401 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.413s	user 0.459s	sys 0.945s
12:12:49.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.285720 13401 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.414s	user 0.459s	sys 0.945s
12:12:49.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:47.872424 13412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:49.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.287441 13414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:49.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.290546 13413 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1414 milliseconds
12:12:49.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.290599 13401 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:49.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.291796 13401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:49.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.294118 13401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:49.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.295480 13401 hybrid_clock.cc:648] HybridClock initialized: now 1783512769295442 us; error 55 us; skew 500 ppm
12:12:49.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.296262 13401 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:49.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.302085 13401 webserver.cc:533] Webserver started at http://127.12.238.252:39959/ using document root <none> and password file <none>
12:12:49.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.302958 13401 fs_manager.cc:362] Metadata directory not provided
12:12:49.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.303144 13401 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:49.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.303526 13401 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:49.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.307744 13401 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data/instance:
12:12:49.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af7399f30e8c4ac2a6c237d96438b2b7"
12:12:49.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:49 on dist-test-slave-vcgh"
12:12:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.308876 13401 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal/instance:
12:12:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af7399f30e8c4ac2a6c237d96438b2b7"
12:12:49.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:49 on dist-test-slave-vcgh"
12:12:49.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.316025 13401 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
12:12:49.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.321542 13427 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:49.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.322716 13401 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.323002 13401 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af7399f30e8c4ac2a6c237d96438b2b7"
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:49 on dist-test-slave-vcgh"
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.323326 13401 fs_report.cc:389] FS layout report
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data/data
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:49.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:49.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:49.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:49.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.369199 13401 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:49.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.370677 13401 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:49.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.371083 13401 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:49.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.438565 13401 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.252:39469
12:12:49.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.438659 13478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.252:39469 every 8 connection(s)
12:12:49.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.441175 13401 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/data/info.pb
12:12:49.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.446607 13479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:49.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.449527 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13401
12:12:49.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.449896 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/master-2/wal/instance
12:12:49.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.457988 13479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } has no permanent_uuid. Determining permanent_uuid...
12:12:49.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.479252 13323 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 6
12:12:49.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.490165 13479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } has no permanent_uuid. Determining permanent_uuid...
12:12:49.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.500255 13479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } has no permanent_uuid. Determining permanent_uuid...
12:12:49.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.506469 13323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: Bootstrap starting.
12:12:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.512837 13323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: Neither blocks nor log segments found. Creating new log.
12:12:49.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.514528 13323 log.cc:826] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: Log is configured to *not* fsync() on all Append() calls
12:12:49.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.518766 13479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: Bootstrap starting.
12:12:49.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.519134 13323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: No bootstrap required, opened a new log
12:12:49.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.525216 13479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: Neither blocks nor log segments found. Creating new log.
12:12:49.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.526945 13479 log.cc:826] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: Log is configured to *not* fsync() on all Append() calls
12:12:49.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.532461 13479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: No bootstrap required, opened a new log
12:12:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.539350 13323 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.540174 13323 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:49.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.540473 13323 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e1bf2233db42c3851346de2fb30e9a, State: Initialized, Role: FOLLOWER
12:12:49.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.541374 13323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.544106 13491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:49.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.545080 13491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: This master's current role is: FOLLOWER
12:12:49.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.545784 13323 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: configured and running, proceeding with master startup.
12:12:49.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.554643 13479 raft_consensus.cc:359] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.555395 13479 raft_consensus.cc:385] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:49.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.555708 13479 raft_consensus.cc:740] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af7399f30e8c4ac2a6c237d96438b2b7, State: Initialized, Role: FOLLOWER
12:12:49.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.556609 13479 consensus_queue.cc:260] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.559149 13497 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:49.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.560098 13497 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: This master's current role is: FOLLOWER
12:12:49.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.560864 13479 sys_catalog.cc:565] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: configured and running, proceeding with master startup.
12:12:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.584424 13507 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.585032 13507 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:49.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.575948 13255 master_runner.cc:187] Error getting master registration for 127.12.238.253:35475: OK, instance_id { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" instance_seqno: 1783512767452841 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:49.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.602721 13255 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:49.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.606451 13515 catalog_manager.cc:1594] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:49.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.606769 13515 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:49.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.625797 13433 tablet.cc:2406] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:49.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.604300 13401 master_runner.cc:187] Error getting master registration for 127.12.238.253:35475: OK, instance_id { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" instance_seqno: 1783512767452841 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:49.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.636226 13401 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:49.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512769749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:49.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:49.766028 13277 tablet.cc:2406] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:49.767 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:12:49.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:12:49.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.869406 13497 raft_consensus.cc:493] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.870095 13399 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } attempt: 7
12:12:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.869916 13497 raft_consensus.cc:515] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.872532 13497 leader_election.cc:290] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22e1bf2233db42c3851346de2fb30e9a (127.12.238.254:35497), 845062ce0b554dc9866f2684e1ae11ab (127.12.238.253:35475)
12:12:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.874359 13298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22e1bf2233db42c3851346de2fb30e9a" is_pre_election: true
12:12:49.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.875270 13298 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af7399f30e8c4ac2a6c237d96438b2b7 in term 0.
12:12:49.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.877002 13428 leader_election.cc:304] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22e1bf2233db42c3851346de2fb30e9a, af7399f30e8c4ac2a6c237d96438b2b7; no voters: 
12:12:49.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.879554 13497 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:49.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.879901 13497 raft_consensus.cc:493] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:49.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.880259 13497 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 0 FOLLOWER]: Advancing to term 1
12:12:49.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.887090 13497 raft_consensus.cc:515] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.890915 13298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22e1bf2233db42c3851346de2fb30e9a"
12:12:49.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.891471 13298 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 0 FOLLOWER]: Advancing to term 1
12:12:49.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.898625 13298 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af7399f30e8c4ac2a6c237d96438b2b7 in term 1.
12:12:49.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.899847 13428 leader_election.cc:304] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22e1bf2233db42c3851346de2fb30e9a, af7399f30e8c4ac2a6c237d96438b2b7; no voters: 
12:12:49.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.900848 13497 leader_election.cc:290] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [CANDIDATE]: Term 1 election: Requested vote from peers 22e1bf2233db42c3851346de2fb30e9a (127.12.238.254:35497), 845062ce0b554dc9866f2684e1ae11ab (127.12.238.253:35475)
12:12:49.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.902304 13497 raft_consensus.cc:2804] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 1 FOLLOWER]: Leader election won for term 1
12:12:49.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.902902 13497 raft_consensus.cc:697] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [term 1 LEADER]: Becoming Leader. State: Replica: af7399f30e8c4ac2a6c237d96438b2b7, State: Running, Role: LEADER
12:12:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.904596 13497 consensus_queue.cc:237] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.921888 13518 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7399f30e8c4ac2a6c237d96438b2b7. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:49.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.929289 13518 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: This master's current role is: LEADER
12:12:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.932003 13399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: Bootstrap starting.
12:12:49.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.940129 13399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: Neither blocks nor log segments found. Creating new log.
12:12:49.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.942634 13399 log.cc:826] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: Log is configured to *not* fsync() on all Append() calls
12:12:49.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.945809 13520 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:12:49.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.953284 13520 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:12:49.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.957911 13399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: No bootstrap required, opened a new log
12:12:49.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.986795 13298 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [term 1 FOLLOWER]: Refusing update from remote peer af7399f30e8c4ac2a6c237d96438b2b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:49.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.988765 13518 consensus_queue.cc:1048] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:49.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.991892 13399 raft_consensus.cc:359] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:49.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.993136 13399 raft_consensus.cc:385] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:49.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.993449 13399 raft_consensus.cc:740] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 845062ce0b554dc9866f2684e1ae11ab, State: Initialized, Role: FOLLOWER
12:12:49.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:49.996107 13399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:50.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.004611 13523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.005340 13523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: This master's current role is: FOLLOWER
12:12:50.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.005745 13523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:50.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.006171 13523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } }
12:12:50.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.010520 13399 sys_catalog.cc:565] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: configured and running, proceeding with master startup.
12:12:50.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.011385 13374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "845062ce0b554dc9866f2684e1ae11ab" is_pre_election: true
12:12:50.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.012035 13374 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af7399f30e8c4ac2a6c237d96438b2b7 in term 0.
12:12:50.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.014910 13372 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 0 FOLLOWER]: Advancing to term 1
12:12:50.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.010695 13373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "845062ce0b554dc9866f2684e1ae11ab"
12:12:50.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.026983 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "845062ce0b554dc9866f2684e1ae11ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" is_pre_election: true
12:12:50.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.027354 13372 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 1 FOLLOWER]: Refusing update from remote peer af7399f30e8c4ac2a6c237d96438b2b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:50.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.028568 13297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "845062ce0b554dc9866f2684e1ae11ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22e1bf2233db42c3851346de2fb30e9a" is_pre_election: true
12:12:50.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.030803 13518 consensus_queue.cc:1048] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:50.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.031024 13350 leader_election.cc:304] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 845062ce0b554dc9866f2684e1ae11ab; no voters: 22e1bf2233db42c3851346de2fb30e9a, af7399f30e8c4ac2a6c237d96438b2b7
12:12:50.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.033501 13525 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:12:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.040572 13523 leader_election.cc:290] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22e1bf2233db42c3851346de2fb30e9a (127.12.238.254:35497), af7399f30e8c4ac2a6c237d96438b2b7 (127.12.238.252:39469)
12:12:50.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.063841 13525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7399f30e8c4ac2a6c237d96438b2b7. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.065122 13525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: This master's current role is: FOLLOWER
12:12:50.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.067982 13491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader af7399f30e8c4ac2a6c237d96438b2b7. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.069073 13491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: This master's current role is: FOLLOWER
12:12:50.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.083824 13491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.084951 13491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a [sys.catalog]: This master's current role is: FOLLOWER
12:12:50.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.093590 13530 mvcc.cc:204] Tried to move back new op lower bound from 7305268305842831360 to 7305268305544192000. Current Snapshot: MvccSnapshot[applied={T|T < 7305268305842831360}]
12:12:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.099521 13525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.100397 13525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab [sys.catalog]: This master's current role is: FOLLOWER
12:12:50.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.109426 13518 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.110085 13518 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: This master's current role is: LEADER
12:12:50.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.110698 13518 sys_catalog.cc:455] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e1bf2233db42c3851346de2fb30e9a" member_type: VOTER last_known_addr { host: "127.12.238.254" port: 35497 } } peers { permanent_uuid: "845062ce0b554dc9866f2684e1ae11ab" member_type: VOTER last_known_addr { host: "127.12.238.253" port: 35475 } } peers { permanent_uuid: "af7399f30e8c4ac2a6c237d96438b2b7" member_type: VOTER last_known_addr { host: "127.12.238.252" port: 39469 } } }
12:12:50.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.111285 13518 sys_catalog.cc:458] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7 [sys.catalog]: This master's current role is: LEADER
12:12:50.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.112242 13520 catalog_manager.cc:1383] Generated new cluster ID: 7448f53709924ba6b4e573aa87abce9b
12:12:50.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.112532 13520 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:12:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.126771 13542 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:12:50.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.156257 13520 catalog_manager.cc:1406] Generated new certificate authority record
12:12:50.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.160272 13520 catalog_manager.cc:1540] Loading token signing keys...
12:12:50.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.191232 13520 catalog_manager.cc:6070] T 00000000000000000000000000000000 P af7399f30e8c4ac2a6c237d96438b2b7: Generated new TSK 0
12:12:50.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.193271 13520 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:12:50.202 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:50.203 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:50.203 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:50.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:50.203 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:50.204 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:50.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:50.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:50.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:50.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:50.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:50.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:50.205 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:50.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.214471 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:50.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:50.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/logs
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data/info.pb
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.193:0
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.193
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.193
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:50.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:50.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512770249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:50.267 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:12:50.269 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:12:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.590798 13507 catalog_manager.cc:1295] Loaded cluster ID: 7448f53709924ba6b4e573aa87abce9b
12:12:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.591352 13507 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: loading cluster ID for follower catalog manager: success
12:12:50.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.594218 13544 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:50.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.595022 13544 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:50.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.595860 13544 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:50.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.598831 13507 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: acquiring CA information for follower catalog manager: success
12:12:50.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.604398 13507 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 22e1bf2233db42c3851346de2fb30e9a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:50.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.633927 13544 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:50.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.634801 13544 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.238.193
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.672124 13544 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.193:0
12:12:50.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data/info.pb
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.193
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.193
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/logs
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:50.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:50.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.673738 13544 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:50.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:50.675320 13544 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:50.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.689277 13550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:50.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512770749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:50.773 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
12:12:50.775 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:12:51.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:51.136457 13542 catalog_manager.cc:1295] Loaded cluster ID: 7448f53709924ba6b4e573aa87abce9b
12:12:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:51.137066 13542 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: loading cluster ID for follower catalog manager: success
12:12:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:51.150655 13542 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: acquiring CA information for follower catalog manager: success
12:12:51.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:51.168599 13542 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 845062ce0b554dc9866f2684e1ae11ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:51.249 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512771249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:51.265 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:12:51.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:12:51.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512771749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:51.768 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
12:12:51.770 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:12:52.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512772249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:52.273 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
12:12:52.276 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:12:52.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:50.692212 13551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:52.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:52.091235 13549 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 13544
12:12:52.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:52.721405 13544 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.031s	user 0.541s	sys 0.761s
12:12:52.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:52.724080 13544 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.034s	user 0.542s	sys 0.761s
12:12:52.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.733443 13544 server_base.cc:1061] running on GCE node
12:12:52.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:52.733685 13558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:52.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.735044 13544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:52.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.737524 13544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:52.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.738947 13544 hybrid_clock.cc:648] HybridClock initialized: now 1783512772738780 us; error 159 us; skew 500 ppm
12:12:52.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.739977 13544 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:52.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.747306 13544 webserver.cc:533] Webserver started at http://127.12.238.193:46017/ using document root <none> and password file <none>
12:12:52.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.748401 13544 fs_manager.cc:362] Metadata directory not provided
12:12:52.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.748656 13544 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:52.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512772749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:52.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.749199 13544 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.754966 13544 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data/instance:
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:52 on dist-test-slave-vcgh"
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.756351 13544 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal/instance:
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:12:52.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:52 on dist-test-slave-vcgh"
12:12:52.775 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=25 ms, finalizationTime=1 ms).
12:12:52.777 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:12:52.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.782585 13544 fs_manager.cc:696] Time spent creating directory manager: real 0.026s	user 0.012s	sys 0.012s
12:12:52.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.789924 13563 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:52.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.791217 13544 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
12:12:52.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.791587 13544 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:52 on dist-test-slave-vcgh"
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.791967 13544 fs_report.cc:389] FS layout report
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data/data
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.882834 13544 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:52.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.884840 13544 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:52.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.885404 13544 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:52.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.888933 13544 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:52.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.894461 13544 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:52.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.894722 13544 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:52.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.894996 13544 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:52.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:52.895207 13544 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:53.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.046171 13544 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.193:33745
12:12:53.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.046240 13676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.193:33745 every 8 connection(s)
12:12:53.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.049813 13544 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/data/info.pb
12:12:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.059736 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13544
12:12:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.060225 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-0/wal/instance
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.089524 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/logs
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data/info.pb
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.194:0
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.194
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.194
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:53.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.109489 13677 heartbeater.cc:344] Connected to a master server at 127.12.238.252:39469
12:12:53.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.109926 13677 heartbeater.cc:461] Registering TS with master...
12:12:53.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.111004 13679 heartbeater.cc:344] Connected to a master server at 127.12.238.254:35497
12:12:53.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.111229 13677 heartbeater.cc:507] Master 127.12.238.252:39469 requested a full tablet report, sending...
12:12:53.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.111408 13679 heartbeater.cc:461] Registering TS with master...
12:12:53.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.112282 13679 heartbeater.cc:507] Master 127.12.238.254:35497 requested a full tablet report, sending...
12:12:53.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.114120 13444 ts_manager.cc:194] Registered new tserver with Master: 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745)
12:12:53.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.115181 13288 ts_manager.cc:194] Registered new tserver with Master: 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745)
12:12:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.116676 13444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.238.193:51553
12:12:53.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.119103 13678 heartbeater.cc:344] Connected to a master server at 127.12.238.253:35475
12:12:53.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.119418 13678 heartbeater.cc:461] Registering TS with master...
12:12:53.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.120081 13678 heartbeater.cc:507] Master 127.12.238.253:35475 requested a full tablet report, sending...
12:12:53.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.122969 13364 ts_manager.cc:194] Registered new tserver with Master: 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745)
12:12:53.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512773249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:53.265 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:12:53.267 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:12:53.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.418248 13687 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:53.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.418776 13687 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:53.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.419325 13687 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:53.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.466259 13687 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:53.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.467553 13687 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.238.194
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.507967 13687 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.194:0
12:12:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data/info.pb
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.194
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.194
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/logs
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:53.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:53.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.511089 13687 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:53.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:53.513260 13687 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:53.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.525750 13694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:53.643 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:53.644 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:53.644 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:53.644 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:53.644 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:53.645 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:53.645 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:53.645 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:53.646 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:53.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:53.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:53.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:53.646 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:53.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512773749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:53.769 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:12:53.772 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:12:54.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:54.120643 13677 heartbeater.cc:499] Master 127.12.238.252:39469 was elected leader, sending a full tablet report...
12:12:54.249 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512774248 for job 6b98bc975be284725b662aff85b5faa8.
12:12:54.268 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:12:54.270 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:12:54.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512774749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:54.769 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=19 ms, finalizationTime=1 ms).
12:12:54.770 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:12:55.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:53.529074 13695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:55.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.235997 13687 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.710s	user 0.573s	sys 1.074s
12:12:55.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.236632 13687 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.711s	user 0.573s	sys 1.074s
12:12:55.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:54.928432 13692 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 13687
12:12:55.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.237214 13696 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1708 milliseconds
12:12:55.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.238039 13697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:55.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.238106 13687 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:55.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.241497 13687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:55.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.243484 13687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:55.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.244779 13687 hybrid_clock.cc:648] HybridClock initialized: now 1783512775244741 us; error 38 us; skew 500 ppm
12:12:55.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.245579 13687 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:55.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512775249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:55.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.251852 13687 webserver.cc:533] Webserver started at http://127.12.238.194:38059/ using document root <none> and password file <none>
12:12:55.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.253129 13687 fs_manager.cc:362] Metadata directory not provided
12:12:55.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.253368 13687 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:55.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.253918 13687 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:55.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.258901 13687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data/instance:
12:12:55.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:12:55.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:55 on dist-test-slave-vcgh"
12:12:55.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.259994 13687 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal/instance:
12:12:55.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:12:55.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:55 on dist-test-slave-vcgh"
12:12:55.265 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:12:55.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:12:55.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.267944 13687 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.005s
12:12:55.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.273428 13706 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.274550 13687 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.274911 13687 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:55 on dist-test-slave-vcgh"
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.275267 13687 fs_report.cc:389] FS layout report
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal
12:12:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data/data
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:55.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.325242 13687 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:55.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.326740 13687 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:55.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.327239 13687 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:55.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.330713 13687 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:55.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.334677 13687 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:55.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.334861 13687 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:55.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.335041 13687 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:55.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.335224 13687 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:55.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.468523 13687 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.194:41781
12:12:55.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.468605 13818 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.194:41781 every 8 connection(s)
12:12:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.472271 13687 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/data/info.pb
12:12:55.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.478144 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13687
12:12:55.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.478691 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-1/wal/instance
12:12:55.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.502417 13243 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/logs
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data/info.pb
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.195:0
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.195
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.195
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:55.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.519663 13819 heartbeater.cc:344] Connected to a master server at 127.12.238.252:39469
12:12:55.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.520097 13819 heartbeater.cc:461] Registering TS with master...
12:12:55.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.521886 13819 heartbeater.cc:507] Master 127.12.238.252:39469 requested a full tablet report, sending...
12:12:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.523084 13821 heartbeater.cc:344] Connected to a master server at 127.12.238.254:35497
12:12:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.523453 13821 heartbeater.cc:461] Registering TS with master...
12:12:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.524310 13821 heartbeater.cc:507] Master 127.12.238.254:35497 requested a full tablet report, sending...
12:12:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.525110 13444 ts_manager.cc:194] Registered new tserver with Master: 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:12:55.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.526700 13444 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.238.194:41405
12:12:55.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.527359 13288 ts_manager.cc:194] Registered new tserver with Master: 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:12:55.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.531800 13820 heartbeater.cc:344] Connected to a master server at 127.12.238.253:35475
12:12:55.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.532090 13820 heartbeater.cc:461] Registering TS with master...
12:12:55.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.532634 13820 heartbeater.cc:507] Master 127.12.238.253:35475 requested a full tablet report, sending...
12:12:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.534782 13364 ts_manager.cc:194] Registered new tserver with Master: 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:12:55.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512775749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:55.763 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:12:55.764 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:12:55.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.856312 13827 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:55.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.856853 13827 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:55.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.857409 13827 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:55.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.890007 13827 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:55.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.890947 13827 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.238.195
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.927131 13827 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.238.212:34813
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.238.195:0
12:12:55.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data/info.pb
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.238.195
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.238.254:35497,127.12.238.253:35475,127.12.238.252:39469
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.238.195
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/logs
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:55.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.928664 13827 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:55.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:55.930405 13827 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:55.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.942396 13835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:56.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512776249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:56.271 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
12:12:56.273 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:12:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:56.531399 13819 heartbeater.cc:499] Master 127.12.238.252:39469 was elected leader, sending a full tablet report...
12:12:56.751 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512776749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:56.773 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=24 ms, finalizationTime=0 ms).
12:12:56.775 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:12:57.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512777248 for job 6b98bc975be284725b662aff85b5faa8.
12:12:57.264 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:12:57.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:12:57.362 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:12:57.363 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:12:57.364 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:57.364 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:12:57.364 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:57.364 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:12:57.364 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:57.365 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:57.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:57.365 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:12:57.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:57.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:12:57.365 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:12:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:55.942953 13836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:57.345139 13834 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 13827
12:12:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:57.490008 13827 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.547s	user 0.630s	sys 0.885s
12:12:57.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:57.491564 13827 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.549s	user 0.630s	sys 0.885s
12:12:57.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:57.496191 13837 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1547 milliseconds
12:12:57.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:57.497107 13838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:57.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.497176 13827 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:57.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.498369 13827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:57.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.500790 13827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:57.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.502180 13827 hybrid_clock.cc:648] HybridClock initialized: now 1783512777502144 us; error 30 us; skew 500 ppm
12:12:57.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.503008 13827 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:57.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.509053 13827 webserver.cc:533] Webserver started at http://127.12.238.195:33411/ using document root <none> and password file <none>
12:12:57.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.509907 13827 fs_manager.cc:362] Metadata directory not provided
12:12:57.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.510089 13827 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:57.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.510454 13827 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:57.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.514863 13827 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data/instance:
12:12:57.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:12:57.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:57 on dist-test-slave-vcgh"
12:12:57.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.515911 13827 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal/instance:
12:12:57.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:12:57.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:57 on dist-test-slave-vcgh"
12:12:57.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.522688 13827 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
12:12:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.528146 13847 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:57.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.529261 13827 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
12:12:57.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.529578 13827 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:57 on dist-test-slave-vcgh"
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.529907 13827 fs_report.cc:389] FS layout report
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data/data
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:57.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:57.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:57.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:57.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.592811 13827 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:57.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.594337 13827 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:57.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.594817 13827 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:57.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.597396 13827 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:57.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.601264 13827 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:57.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.601450 13827 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:57.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.601645 13827 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:57.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.601778 13827 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:57.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.730686 13827 rpc_server.cc:307] RPC server started. Bound to: 127.12.238.195:41959
12:12:57.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.730793 13959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.238.195:41959 every 8 connection(s)
12:12:57.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.733084 13827 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/data/info.pb
12:12:57.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.738245 13243 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13827
12:12:57.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.738698 13243 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster18335104933059909509/ts-2/wal/instance
12:12:57.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512777749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:57.779 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=29 ms, finalizationTime=1 ms).
12:12:57.780 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:12:57.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.805536 13962 heartbeater.cc:344] Connected to a master server at 127.12.238.254:35497
12:12:57.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.806054 13962 heartbeater.cc:461] Registering TS with master...
12:12:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.807327 13962 heartbeater.cc:507] Master 127.12.238.254:35497 requested a full tablet report, sending...
12:12:57.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.810185 13288 ts_manager.cc:194] Registered new tserver with Master: 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:12:57.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.814862 13961 heartbeater.cc:344] Connected to a master server at 127.12.238.253:35475
12:12:57.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.815160 13961 heartbeater.cc:461] Registering TS with master...
12:12:57.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.815953 13961 heartbeater.cc:507] Master 127.12.238.253:35475 requested a full tablet report, sending...
12:12:57.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.817380 13960 heartbeater.cc:344] Connected to a master server at 127.12.238.252:39469
12:12:57.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.817694 13960 heartbeater.cc:461] Registering TS with master...
12:12:57.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.818533 13960 heartbeater.cc:507] Master 127.12.238.252:39469 requested a full tablet report, sending...
12:12:57.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.818485 13364 ts_manager.cc:194] Registered new tserver with Master: 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:12:57.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.821576 13443 ts_manager.cc:194] Registered new tserver with Master: 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:12:57.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.824606 13443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.238.195:52211
12:12:57.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:57.833973 13243 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:12:57.850 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:57.851 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:12:57.853 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.238.254"
      port: 35497
    }
    bound_http_address {
      host: "127.12.238.254"
      port: 42005
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.12.238.253"
      port: 35475
    }
    bound_http_address {
      host: "127.12.238.253"
      port: 45889
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.12.238.252"
      port: 39469
    }
    bound_http_address {
      host: "127.12.238.252"
      port: 39959
    }
  }
}

12:12:57.853 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:12:57.858 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.238.193"
      port: 33745
    }
    bound_http_address {
      host: "127.12.238.193"
      port: 46017
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.12.238.194"
      port: 41781
    }
    bound_http_address {
      host: "127.12.238.194"
      port: 38059
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.12.238.195"
      port: 41959
    }
    bound_http_address {
      host: "127.12.238.195"
      port: 33411
    }
  }
}

12:12:57.858 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:12:57.860 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:57.861 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:12:57.861 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:12:57.861 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:12:57.861 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:12:57.869 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:12:58.188 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:58.188 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:12:58.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.191609 13971 mini_oidc.cc:150] Starting JWKS server
12:12:58.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.194540 13971 webserver.cc:533] Webserver started at http://127.0.0.1:37715/ using document root <none> and password file <none>
12:12:58.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.194907 13971 mini_oidc.cc:186] Starting OIDC Discovery server
12:12:58.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.196491 13971 webserver.cc:533] Webserver started at http://127.0.0.1:39497/ using document root <none> and password file <none>
12:12:58.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:58Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:12:58.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:58Z Disabled control of system clock
12:12:58.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512778249 for job 6b98bc975be284725b662aff85b5faa8.
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.253890 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/logs
12:12:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data/info.pb
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.254:45345
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.254
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json with env {}
12:12:58.261 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:12:58.263 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:12:58.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.553779 13983 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:58.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.554378 13983 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:58.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.554845 13983 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:58.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.587968 13983 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:58.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.588245 13983 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:58.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.588436 13983 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:58.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.588632 13983 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:58.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.588871 13983 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:58.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.589025 13983 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37715/jwks.json
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.625104 13983 master_runner.cc:387] Master server non-default flags:
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.254:45345
12:12:58.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data/info.pb
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.254
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/logs
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.626566 13983 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:58.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.628258 13983 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:58.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.638281 13989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:58.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512778749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:58.771 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
12:12:58.773 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:12:58.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:58.829243 13960 heartbeater.cc:499] Master 127.12.238.252:39469 was elected leader, sending a full tablet report...
12:12:59.249 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512779248 for job 6b98bc975be284725b662aff85b5faa8.
12:12:59.270 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
12:12:59.272 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:12:59.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512779749 for job 6b98bc975be284725b662aff85b5faa8.
12:12:59.768 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=18 ms, finalizationTime=1 ms).
12:12:59.770 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:12:59.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:58.638840 13990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:59.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:59.952457 13992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:59.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:59.954732 13991 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1311 milliseconds
12:12:59.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:59.955514 13983 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.317s	user 0.465s	sys 0.821s
12:12:59.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:59.955791 13983 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.317s	user 0.465s	sys 0.821s
12:12:59.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.956060 13983 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:59.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.957216 13983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:59.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.959674 13983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:59.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.960999 13983 hybrid_clock.cc:648] HybridClock initialized: now 1783512779960969 us; error 41 us; skew 500 ppm
12:12:59.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.961790 13983 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:59.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.969769 13983 webserver.cc:533] Webserver started at http://127.13.164.254:39269/ using document root <none> and password file <none>
12:12:59.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.970674 13983 fs_manager.cc:362] Metadata directory not provided
12:12:59.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.970886 13983 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:59.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.971392 13983 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:59.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.975594 13983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data/instance:
12:12:59.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b84c4c91e6e9463fbb78a19996d6ba62"
12:12:59.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:59 on dist-test-slave-vcgh"
12:12:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.976809 13983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal/instance:
12:12:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b84c4c91e6e9463fbb78a19996d6ba62"
12:12:59.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:59 on dist-test-slave-vcgh"
12:12:59.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.984380 13983 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
12:12:59.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.990082 13999 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.991284 13983 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:12:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.991619 13983 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b84c4c91e6e9463fbb78a19996d6ba62"
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:59 on dist-test-slave-vcgh"
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:59.991950 13983 fs_report.cc:389] FS layout report
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data/data
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:59.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:00.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.053900 13983 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:00.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.055724 13983 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:00.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.056265 13983 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:00.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.124045 13983 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.254:45345
12:13:00.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.124122 14050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.254:45345 every 8 connection(s)
12:13:00.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.126641 13983 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/data/info.pb
12:13:00.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.127892 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 13983
12:13:00.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.128391 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-0/wal/instance
12:13:00.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.133527 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:00.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:00.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal
12:13:00.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/logs
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data/info.pb
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.253:36317
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.253
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json with env {}
12:13:00.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.133881 14051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:00.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.144542 14051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } has no permanent_uuid. Determining permanent_uuid...
12:13:00.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.175684 14051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } has no permanent_uuid. Determining permanent_uuid...
12:13:00.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.178395 14003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.182698 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.232151 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 1
12:13:00.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.236585 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512780249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:00.260 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:13:00.260 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:13:00.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.304977 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 2
12:13:00.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.308980 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.400429 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 3
12:13:00.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.404431 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.432150 14053 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:00.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.432670 14053 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:00.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.433179 14053 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:00.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.473143 14053 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:00.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.473474 14053 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:00.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.473816 14053 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:00.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.474156 14053 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:00.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.474478 14053 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:00.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.474699 14053 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37715/jwks.json
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.520922 14053 master_runner.cc:387] Master server non-default flags:
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.253:36317
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data/info.pb
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.253
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/logs
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:00.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.522574 14053 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:00.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.524183 14053 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:00.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.534226 14062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:00.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.547950 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 4
12:13:00.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.557603 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:00.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512780749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:00.760 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:13:00.761 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:13:00.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:00.856981 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 5
12:13:00.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.861114 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:01.002 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:01.003 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:01.004 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:01.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:01.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:01.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:01.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:01.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:01.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:01.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:01.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:01.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:01.005 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:01.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512781249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:01.261 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:13:01.262 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:13:01.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.408483 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 6
12:13:01.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:01.415092 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.253:36317: Network error: Client connection negotiation failed: client connection to 127.13.164.253:36317: connect: Connection refused (error 111)
12:13:01.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.534597 14063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:01.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:00.538832 14065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:01.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:01.671840 14064 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
12:13:01.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.671865 14053 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:01.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.676388 14053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.679070 14053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:01.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.680415 14053 hybrid_clock.cc:648] HybridClock initialized: now 1783512781680380 us; error 47 us; skew 500 ppm
12:13:01.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.681200 14053 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:01.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.687503 14053 webserver.cc:533] Webserver started at http://127.13.164.253:44327/ using document root <none> and password file <none>
12:13:01.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.688611 14053 fs_manager.cc:362] Metadata directory not provided
12:13:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.688884 14053 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.689415 14053 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:01.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.694490 14053 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data/instance:
12:13:01.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "472175e511fd417ca8097395297edd20"
12:13:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:01 on dist-test-slave-vcgh"
12:13:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.695518 14053 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal/instance:
12:13:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "472175e511fd417ca8097395297edd20"
12:13:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:01 on dist-test-slave-vcgh"
12:13:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.702621 14053 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
12:13:01.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.708103 14076 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:01.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.709151 14053 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:13:01.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.709452 14053 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal
12:13:01.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "472175e511fd417ca8097395297edd20"
12:13:01.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:01 on dist-test-slave-vcgh"
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.709856 14053 fs_report.cc:389] FS layout report
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data/data
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:01.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512781749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:01.759 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:13:01.760 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:13:01.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.764461 14053 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:01.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.765960 14053 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:01.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.766355 14053 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:01.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.833077 14053 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.253:36317
12:13:01.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.833226 14127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.253:36317 every 8 connection(s)
12:13:01.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.836426 14053 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/data/info.pb
12:13:01.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.843312 14128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:01.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.846989 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 14053
12:13:01.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.847460 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-1/wal/instance
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.850222 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/logs
12:13:01.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data/info.pb
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.252:40513
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.252
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json with env {}
12:13:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.857122 14128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } has no permanent_uuid. Determining permanent_uuid...
12:13:01.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.881886 14128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } has no permanent_uuid. Determining permanent_uuid...
12:13:01.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.896137 14128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } has no permanent_uuid. Determining permanent_uuid...
12:13:01.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:01.898762 14077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:01.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:01.902805 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:01.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:01.952253 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 1
12:13:01.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:01.956838 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.025163 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 2
12:13:02.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.029588 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.120980 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 3
12:13:02.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.125444 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.166922 14130 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:02.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.167456 14130 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:02.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.167930 14130 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:02.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.202281 14130 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:02.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.202551 14130 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:02.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.202749 14130 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:02.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.203053 14130 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:02.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.203388 14130 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:02.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.203652 14130 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37715/jwks.json
12:13:02.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512782249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:02.260 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:13:02.261 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.268164 14130 master_runner.cc:387] Master server non-default flags:
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:02.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.252:40513
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37715/jwks.json
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data/info.pb
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.252
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/logs
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.269002 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 4
12:13:02.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.269976 14130 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:02.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.272277 14130 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:02.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.273754 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.288641 14140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:02.323 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:02.324 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:02.324 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:02.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.326 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:02.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.475569 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } attempt: 7
12:13:02.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.506860 14051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } has no permanent_uuid. Determining permanent_uuid...
12:13:02.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.523885 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.573101 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 5
12:13:02.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.578770 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.582402 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 1
12:13:02.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.588532 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.670018 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 2
12:13:02.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.675706 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512782749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:02.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.761273 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 3
12:13:02.764 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:13:02.764 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:13:02.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.768610 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.802 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:02.803 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:02.804 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:02.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.805 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.807 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:02.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:02.909164 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 4
12:13:02.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.914847 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:02.922 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:02.923 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:02.923 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:02.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:02.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:02.925 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.925 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.925 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:02.925 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:03.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.126242 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 6
12:13:03.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.144975 14128 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:03.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.198297 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 5
12:13:03.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.203784 14051 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.13.164.252:40513: Network error: Client connection negotiation failed: client connection to 127.13.164.252:40513: connect: Connection refused (error 111)
12:13:03.251 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512783249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:03.262 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:13:03.263 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:13:03.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:02.289916 14141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:03.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.522025 14143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:03.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.525615 14142 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1234 milliseconds
12:13:03.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.525758 14130 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:03.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.526885 14130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:03.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.529352 14130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:03.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.530719 14130 hybrid_clock.cc:648] HybridClock initialized: now 1783512783530695 us; error 29 us; skew 500 ppm
12:13:03.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.531512 14130 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.537402 14130 webserver.cc:533] Webserver started at http://127.13.164.252:32895/ using document root <none> and password file <none>
12:13:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.538290 14130 fs_manager.cc:362] Metadata directory not provided
12:13:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.538496 14130 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.538973 14130 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:03.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.543102 14130 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data/instance:
12:13:03.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78"
12:13:03.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:03 on dist-test-slave-vcgh"
12:13:03.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.544251 14130 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal/instance:
12:13:03.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78"
12:13:03.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:03 on dist-test-slave-vcgh"
12:13:03.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.551476 14130 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.002s
12:13:03.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.557217 14156 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.558307 14130 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
12:13:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.558578 14130 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal
12:13:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78"
12:13:03.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:03 on dist-test-slave-vcgh"
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.558859 14130 fs_report.cc:389] FS layout report
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data/data
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:03.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.611166 14130 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:03.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.612802 14130 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:03.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.613312 14130 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:03.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.684021 14130 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.252:40513
12:13:03.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.684088 14208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.252:40513 every 8 connection(s)
12:13:03.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.686908 14130 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/data/info.pb
12:13:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.694512 14209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:03.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.696174 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 14130
12:13:03.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.696579 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/master-2/wal/instance
12:13:03.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.707384 14209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } has no permanent_uuid. Determining permanent_uuid...
12:13:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.732977 14209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } has no permanent_uuid. Determining permanent_uuid...
12:13:03.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.743526 14209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } has no permanent_uuid. Determining permanent_uuid...
12:13:03.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512783749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.756505 14051 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 6
12:13:03.767 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:13:03.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.767441 14209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: Bootstrap starting.
12:13:03.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:13:03.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.779934 14209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: Neither blocks nor log segments found. Creating new log.
12:13:03.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.782171 14209 log.cc:826] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: Log is configured to *not* fsync() on all Append() calls
12:13:03.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.784371 14051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: Bootstrap starting.
12:13:03.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.791127 14051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: Neither blocks nor log segments found. Creating new log.
12:13:03.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.791821 14209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: No bootstrap required, opened a new log
12:13:03.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.793038 14051 log.cc:826] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: Log is configured to *not* fsync() on all Append() calls
12:13:03.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.803601 14051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: No bootstrap required, opened a new log
12:13:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.812251 14209 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.812918 14209 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.813120 14209 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f282fabf5e4e3bb7bcfd08e17bcb78, State: Initialized, Role: FOLLOWER
12:13:03.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.813766 14209 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:03.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.816280 14220 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:03.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.817095 14220 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: This master's current role is: FOLLOWER
12:13:03.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.817572 14209 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: configured and running, proceeding with master startup.
12:13:03.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.828274 14051 raft_consensus.cc:359] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:03.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.829141 14051 raft_consensus.cc:385] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:03.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.829427 14051 raft_consensus.cc:740] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b84c4c91e6e9463fbb78a19996d6ba62, State: Initialized, Role: FOLLOWER
12:13:03.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.830608 14051 consensus_queue.cc:260] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:03.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.839144 14227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:03.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.842653 14227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: This master's current role is: FOLLOWER
12:13:03.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.842327 14051 sys_catalog.cc:565] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: configured and running, proceeding with master startup.
12:13:03.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.868510 14162 tablet.cc:2406] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.889213 14237 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:13:03.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.889575 14237 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:13:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.916851 14244 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:13:03.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:03.917201 14244 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:13:03.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.883141 14130 master_runner.cc:187] Error getting master registration for 127.13.164.254:45345: OK, instance_id { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" instance_seqno: 1783512780106621 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:03.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.921756 14130 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:03.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.904155 13983 master_runner.cc:187] Error getting master registration for 127.13.164.253:36317: OK, instance_id { permanent_uuid: "472175e511fd417ca8097395297edd20" instance_seqno: 1783512781813738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:03.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:03.936867 13983 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:04.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.057503 14220 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:04.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.058270 14220 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.062669 14026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" is_pre_election: true
12:13:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.063577 14026 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1f282fabf5e4e3bb7bcfd08e17bcb78 in term 0.
12:13:04.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:04.064595 14005 tablet.cc:2406] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:04.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.064595 14220 leader_election.cc:290] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b84c4c91e6e9463fbb78a19996d6ba62 (127.13.164.254:45345), 472175e511fd417ca8097395297edd20 (127.13.164.253:36317)
12:13:04.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.065680 14159 leader_election.cc:304] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b84c4c91e6e9463fbb78a19996d6ba62, f1f282fabf5e4e3bb7bcfd08e17bcb78; no voters: 
12:13:04.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.066531 14220 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:04.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.066988 14220 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:04.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.067303 14220 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 0 FOLLOWER]: Advancing to term 1
12:13:04.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.074647 14220 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:04.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.083904 14026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84c4c91e6e9463fbb78a19996d6ba62"
12:13:04.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.084481 14026 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 0 FOLLOWER]: Advancing to term 1
12:13:04.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.091120 14026 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1f282fabf5e4e3bb7bcfd08e17bcb78 in term 1.
12:13:04.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.092494 14159 leader_election.cc:304] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b84c4c91e6e9463fbb78a19996d6ba62, f1f282fabf5e4e3bb7bcfd08e17bcb78; no voters: 
12:13:04.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.096238 14246 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 1 FOLLOWER]: Leader election won for term 1
12:13:04.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.097563 14220 leader_election.cc:290] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [CANDIDATE]: Term 1 election: Requested vote from peers b84c4c91e6e9463fbb78a19996d6ba62 (127.13.164.254:45345), 472175e511fd417ca8097395297edd20 (127.13.164.253:36317)
12:13:04.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.110244 14246 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [term 1 LEADER]: Becoming Leader. State: Replica: f1f282fabf5e4e3bb7bcfd08e17bcb78, State: Running, Role: LEADER
12:13:04.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.111593 14246 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:04.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.135867 14220 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f282fabf5e4e3bb7bcfd08e17bcb78. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.136591 14220 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: This master's current role is: LEADER
12:13:04.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.146873 14250 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:13:04.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.156893 14250 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:13:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.202790 14026 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [term 1 FOLLOWER]: Refusing update from remote peer f1f282fabf5e4e3bb7bcfd08e17bcb78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:04.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.204738 14246 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:04.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.205407 14128 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } attempt: 7
12:13:04.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.236668 14251 mvcc.cc:204] Tried to move back new op lower bound from 7305268364036182016 to 7305268363734269952. Current Snapshot: MvccSnapshot[applied={T|T < 7305268364036182016}]
12:13:04.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.239746 14227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f282fabf5e4e3bb7bcfd08e17bcb78. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.240481 14227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: This master's current role is: FOLLOWER
12:13:04.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512784249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:04.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.254683 14247 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.255409 14247 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: This master's current role is: LEADER
12:13:04.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.256371 14128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: Bootstrap starting.
12:13:04.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.259985 14250 catalog_manager.cc:1383] Generated new cluster ID: a03e2297fd284e80993f7de2441265f2
12:13:04.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.260249 14250 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:13:04.264 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
12:13:04.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.265096 14227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.265 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:13:04.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.265793 14227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62 [sys.catalog]: This master's current role is: FOLLOWER
12:13:04.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.288297 14128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: Neither blocks nor log segments found. Creating new log.
12:13:04.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.297314 14128 log.cc:826] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: Log is configured to *not* fsync() on all Append() calls
12:13:04.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.311867 14128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: No bootstrap required, opened a new log
12:13:04.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.376344 14250 catalog_manager.cc:1406] Generated new certificate authority record
12:13:04.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.378459 14250 catalog_manager.cc:1540] Loading token signing keys...
12:13:04.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.387214 14128 raft_consensus.cc:359] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:04.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.394256 14128 raft_consensus.cc:385] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:04.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.395270 14128 raft_consensus.cc:740] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472175e511fd417ca8097395297edd20, State: Initialized, Role: FOLLOWER
12:13:04.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.397861 14128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } }
12:13:04.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.413729 14259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.414503 14259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: This master's current role is: FOLLOWER
12:13:04.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.423493 14128 sys_catalog.cc:565] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: configured and running, proceeding with master startup.
12:13:04.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.424043 14250 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78: Generated new TSK 0
12:13:04.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.425323 14250 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:13:04.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.423628 14103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472175e511fd417ca8097395297edd20" is_pre_election: true
12:13:04.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.424676 14101 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [term 0 FOLLOWER]: Advancing to term 1
12:13:04.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.425191 14102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472175e511fd417ca8097395297edd20"
12:13:04.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.435387 14101 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [term 1 FOLLOWER]: Refusing update from remote peer f1f282fabf5e4e3bb7bcfd08e17bcb78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:04.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.437311 14220 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.459724 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/logs
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data/info.pb
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.193:0
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.193
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.193
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:04.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:04.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:04.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:04.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:04.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:04.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.534443 14259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f282fabf5e4e3bb7bcfd08e17bcb78. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.535154 14259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: This master's current role is: FOLLOWER
12:13:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.535931 14268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.545796 14268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20 [sys.catalog]: This master's current role is: FOLLOWER
12:13:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.558739 14276 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:13:04.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512784749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:04.766 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:13:04.768 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:13:04.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.866282 14220 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b84c4c91e6e9463fbb78a19996d6ba62" member_type: VOTER last_known_addr { host: "127.13.164.254" port: 45345 } } peers { permanent_uuid: "472175e511fd417ca8097395297edd20" member_type: VOTER last_known_addr { host: "127.13.164.253" port: 36317 } } peers { permanent_uuid: "f1f282fabf5e4e3bb7bcfd08e17bcb78" member_type: VOTER last_known_addr { host: "127.13.164.252" port: 40513 } } }
12:13:04.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.866966 14220 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f282fabf5e4e3bb7bcfd08e17bcb78 [sys.catalog]: This master's current role is: LEADER
12:13:04.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.922885 14244 catalog_manager.cc:1295] Loaded cluster ID: a03e2297fd284e80993f7de2441265f2
12:13:04.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.923367 14244 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: loading cluster ID for follower catalog manager: success
12:13:04.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.946484 14244 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: acquiring CA information for follower catalog manager: success
12:13:04.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:04.952220 14244 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b84c4c91e6e9463fbb78a19996d6ba62: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:05.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.115650 14267 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:05.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.116557 14267 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:05.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.117501 14267 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:05.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.174481 14267 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:05.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.176185 14267 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.164.193
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.237645 14267 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.193:0
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data/info.pb
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.193
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.193
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/logs
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:05.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:05.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:05.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.240342 14267 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:05.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.242897 14267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:05.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512785249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:05.260 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:13:05.261 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:13:05.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.304917 14283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:05.465 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [5ms] received response from server master-127.11.38.61:36393: OK, deferred=null) with no deferred attached!
12:13:05.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.572757 14276 catalog_manager.cc:1295] Loaded cluster ID: a03e2297fd284e80993f7de2441265f2
12:13:05.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.573302 14276 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: loading cluster ID for follower catalog manager: success
12:13:05.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.580219 14276 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: acquiring CA information for follower catalog manager: success
12:13:05.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:05.585882 14276 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 472175e511fd417ca8097395297edd20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:05.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512785748 for job 6b98bc975be284725b662aff85b5faa8.
12:13:05.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.762642 13673 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba560 after lost signal to thread 13545
12:13:05.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.763815 13673 debug-util.cc:398] Leaking SignalData structure 0x7b08000adb00 after lost signal to thread 13676
12:13:05.767 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
12:13:05.769 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:13:05.802 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:05.803 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:05.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:05.804 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:05.804 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:05.804 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:05.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:05.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:05.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:05.809 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:05.809 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:05.809 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:05.809 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:06.249 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512786249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:06.266 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:13:06.268 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:13:06.662 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:06.663 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:06.663 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:06.664 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:06.664 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:06.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:06.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:06.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:06.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:06.666 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:06.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:06.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:06.667 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:06.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512786749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:06.769 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:13:06.771 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:13:07.171 [DEBUG - pool-15-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.11.220.61:39401, [7ms] received response from server master-127.11.220.61:39401: OK, deferred=null) with no deferred attached!
12:13:07.171 [DEBUG - pool-15-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.11.220.61:39401, [12ms] received response from server master-127.11.220.61:39401: OK, deferred=null) with no deferred attached!
12:13:07.175 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30018), Traces: [0ms] sending RPC to server master-127.11.220.61:39401, [6ms] received response from server master-127.11.220.61:39401: OK, deferred=null) with no deferred attached!
12:13:07.175 [DEBUG - pool-16-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.11.220.61:39401, [6ms] received response from server master-127.11.220.61:39401: OK, deferred=null) with no deferred attached!
12:13:07.184 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:07.184 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:07.185 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.185 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.185 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:07.185 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.188 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.188 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.189 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.189 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:07.251 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512787249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:07.262 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:07.263 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:13:07.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512787749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:07.770 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:13:07.771 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
12:13:07.982 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:07.983 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:07.983 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:07.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:07.987 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.987 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:07.987 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.987 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:07.988 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:06.685119 14281 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 14267
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:08.105854 14281 kernel_stack_watchdog.cc:198] Thread 14267 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 380ms:
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:13:08.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:13:08.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:05.305656 14282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:08.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:08.106771 14267 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.804s	user 0.831s	sys 1.129s
12:13:08.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:08.107349 14267 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.805s	user 0.831s	sys 1.129s
12:13:08.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.121369 14267 server_base.cc:1061] running on GCE node
12:13:08.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:08.122733 14291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:08.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.124428 14267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:08.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.138176 14267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:08.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.141791 14267 hybrid_clock.cc:648] HybridClock initialized: now 1783512788141732 us; error 52 us; skew 500 ppm
12:13:08.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.142910 14267 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:08.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.160317 14267 webserver.cc:533] Webserver started at http://127.13.164.193:39585/ using document root <none> and password file <none>
12:13:08.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.161525 14267 fs_manager.cc:362] Metadata directory not provided
12:13:08.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.161813 14267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:08.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.162433 14267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.168529 14267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data/instance:
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:08 on dist-test-slave-vcgh"
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.170043 14267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal/instance:
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:08.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:08 on dist-test-slave-vcgh"
12:13:08.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.179687 14267 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
12:13:08.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.187999 14297 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:08.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.190189 14267 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.004s
12:13:08.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.190768 14267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal
12:13:08.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:08.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:08 on dist-test-slave-vcgh"
12:13:08.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.191404 14267 fs_report.cc:389] FS layout report
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data/data
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:08.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:08.249 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512788249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:08.263 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:08.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.263801 14267 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:08.266 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
12:13:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.266352 14267 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.267107 14267 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:08.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.286820 14267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.305923 14267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.307431 14267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.002s	user 0.001s	sys 0.001s
12:13:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.307946 14267 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.308349 14267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:08.749 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512788749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:08.762 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:08.763 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
12:13:08.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.958411 14267 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.193:45803
12:13:08.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.958487 14410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.193:45803 every 8 connection(s)
12:13:08.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.962083 14267 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/data/info.pb
12:13:08.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.970805 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 14267
12:13:08.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.971385 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-0/wal/instance
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:08.995209 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/logs
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data/info.pb
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.194:0
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.194
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.194
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:09.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.064486 14412 heartbeater.cc:344] Connected to a master server at 127.13.164.252:40513
12:13:09.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.065016 14412 heartbeater.cc:461] Registering TS with master...
12:13:09.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.066314 14412 heartbeater.cc:507] Master 127.13.164.252:40513 requested a full tablet report, sending...
12:13:09.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.069336 14173 ts_manager.cc:194] Registered new tserver with Master: 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:09.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.071875 14173 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.164.193:33249
12:13:09.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.073144 14415 heartbeater.cc:344] Connected to a master server at 127.13.164.254:45345
12:13:09.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.073498 14415 heartbeater.cc:461] Registering TS with master...
12:13:09.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.074375 14415 heartbeater.cc:507] Master 127.13.164.254:45345 requested a full tablet report, sending...
12:13:09.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.077397 14016 ts_manager.cc:194] Registered new tserver with Master: 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:09.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.083950 14411 heartbeater.cc:344] Connected to a master server at 127.13.164.253:36317
12:13:09.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.086285 14411 heartbeater.cc:461] Registering TS with master...
12:13:09.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.086918 14411 heartbeater.cc:507] Master 127.13.164.253:36317 requested a full tablet report, sending...
12:13:09.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.089859 14093 ts_manager.cc:194] Registered new tserver with Master: 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:09.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512789249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:09.267 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:13:09.268 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
12:13:09.381 [DEBUG - pool-12-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [4ms] received response from server master-127.11.38.61:36393: OK, deferred=null) with no deferred attached!
12:13:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.488848 14418 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.489476 14418 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:09.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.490157 14418 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:09.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.529924 14418 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:09.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.530763 14418 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.164.194
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.566789 14418 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.194:0
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data/info.pb
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.194
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.194
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/logs
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:09.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:09.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.568012 14418 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:09.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:09.569542 14418 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:09.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.583364 14428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:09.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512789749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:09.762 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:09.762 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
12:13:10.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.080057 14412 heartbeater.cc:499] Master 127.13.164.252:40513 was elected leader, sending a full tablet report...
12:13:10.250 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512790249 for job 6b98bc975be284725b662aff85b5faa8.
12:13:10.262 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:10.263 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
12:13:10.750 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512790749 for job 6b98bc975be284725b662aff85b5faa8.
12:13:10.765 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 6b98bc975be284725b662aff85b5faa8 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
12:13:10.766 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
12:13:10.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.584012 14427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:10.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:09.586272 14430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:10.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:10.817819 14429 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1229 milliseconds
12:13:10.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.817920 14418 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:10.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.819031 14418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:10.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.821234 14418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:10.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.822587 14418 hybrid_clock.cc:648] HybridClock initialized: now 1783512790822542 us; error 51 us; skew 500 ppm
12:13:10.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.823378 14418 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.845005 14418 webserver.cc:533] Webserver started at http://127.13.164.194:38355/ using document root <none> and password file <none>
12:13:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.846846 14418 fs_manager.cc:362] Metadata directory not provided
12:13:10.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.847960 14418 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:10.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.848714 14418 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:10.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.854898 14418 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data/instance:
12:13:10.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:10.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:10 on dist-test-slave-vcgh"
12:13:10.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.856578 14418 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal/instance:
12:13:10.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:10.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:10 on dist-test-slave-vcgh"
12:13:10.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.865885 14418 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
12:13:10.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.873136 14439 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.874176 14418 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
12:13:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.874500 14418 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal
12:13:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:10 on dist-test-slave-vcgh"
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.874828 14418 fs_report.cc:389] FS layout report
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data/data
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:10.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.926294 14418 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:10.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.927886 14418 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:10.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.928336 14418 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:10.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.930903 14418 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.935303 14418 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.935489 14418 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.935686 14418 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:10.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:10.935814 14418 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:11.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.065490 14418 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.194:45355
12:13:11.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.065618 14551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.194:45355 every 8 connection(s)
12:13:11.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.068006 14418 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/data/info.pb
12:13:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.075168 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 14418
12:13:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.075594 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-1/wal/instance
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.090056 13971 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/logs
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data/info.pb
12:13:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.195:0
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.195
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.195
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:11.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:11.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.139781 14553 heartbeater.cc:344] Connected to a master server at 127.13.164.252:40513
12:13:11.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.140877 14553 heartbeater.cc:461] Registering TS with master...
12:13:11.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.142205 14553 heartbeater.cc:507] Master 127.13.164.252:40513 requested a full tablet report, sending...
12:13:11.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.144742 14172 ts_manager.cc:194] Registered new tserver with Master: ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.146495 14172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.164.194:46481
12:13:11.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.147895 14554 heartbeater.cc:344] Connected to a master server at 127.13.164.254:45345
12:13:11.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.148242 14554 heartbeater.cc:461] Registering TS with master...
12:13:11.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.149130 14554 heartbeater.cc:507] Master 127.13.164.254:45345 requested a full tablet report, sending...
12:13:11.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.149780 14552 heartbeater.cc:344] Connected to a master server at 127.13.164.253:36317
12:13:11.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.150099 14552 heartbeater.cc:461] Registering TS with master...
12:13:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.151052 14552 heartbeater.cc:507] Master 127.13.164.253:36317 requested a full tablet report, sending...
12:13:11.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.151634 14016 ts_manager.cc:194] Registered new tserver with Master: ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:11.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.153681 14093 ts_manager.cc:194] Registered new tserver with Master: ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:11.182 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.182 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.183 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.183 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.184 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.186 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [3ms] received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [67ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [487ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [821ms] refreshing cache from master, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [825ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [825ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1305ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3302ms] refreshing cache from master, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3306ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6961ms] refreshing cache from master, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [6965ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6965ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [8841ms] refreshing cache from master, [8842ms] too many traces: truncated at 100 traces, deferred=Deferred@14809196(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2d6eaffa -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244)))
12:13:11.188 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.188 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.188 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [3ms] received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [67ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [487ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [821ms] refreshing cache from master, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [825ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [825ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1305ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3302ms] refreshing cache from master, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3306ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6961ms] refreshing cache from master, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [6965ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6965ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [8841ms] refreshing cache from master, [8842ms] too many traces: truncated at 100 traces, deferred=Deferred@14809196(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2d6eaffa -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [3ms] received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [67ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [487ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [821ms] refreshing cache from master, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [825ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [825ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1305ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3302ms] refreshing cache from master, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3306ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6961ms] refreshing cache from master, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [6965ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6965ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [8841ms] refreshing cache from master, [8842ms] too many traces: truncated at 100 traces, deferred=Deferred@14809196(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2d6eaffa -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:11.189 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.189 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.189 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.189 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.190 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.190 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.190 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.191 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.203 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.203 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.204 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.204 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.204 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.204 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.205 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.205 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.205 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.205 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.219 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [3ms] received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [67ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [487ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [821ms] refreshing cache from master, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [825ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [825ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1305ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3302ms] refreshing cache from master, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3306ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6961ms] refreshing cache from master, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [6965ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6965ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [8841ms] refreshing cache from master, [8842ms] too many traces: truncated at 100 traces, deferred=Deferred@14809196(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2d6eaffa -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=29824), Traces: [0ms] sending RPC to server master-127.11.38.61:36393, [3ms] received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [25ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [42ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [67ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [105ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [141ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [487ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [821ms] refreshing cache from master, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [823ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [825ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [825ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1302ms] refreshing cache from master, [1302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1305ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3302ms] refreshing cache from master, [3302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3304ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3305ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3306ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3306ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6961ms] refreshing cache from master, [6962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [6964ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [6965ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6965ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [8841ms] refreshing cache from master, [8842ms] too many traces: truncated at 100 traces, deferred=Deferred@14809196(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2d6eaffa -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@2080456052 after retry RPC after error@2077895097) -> (continuation of Deferred@1953991734 after retry RPC after error@742321213) -> (continuation of Deferred@1503764051 after retry RPC after error@1931273023) -> (continuation of Deferred@1002620758 after retry RPC after error@1615235863) -> (continuation of Deferred@893440586 after retry RPC after error@567397062) -> (continuation of Deferred@209998301 after retry RPC after error@1489927529) -> (continuation of Deferred@1798252216 after retry RPC after error@1149720289) -> (continuation of Deferred@1789127957 after retry RPC after error@1101918237) -> (continuation of Deferred@1403323510 after retry RPC after error@770400445) -> (continuation of Deferred@1482025808 after retry RPC after error@1985402207) -> (continuation of Deferred@229370199 after retry RPC after error@2066976471) -> (continuation of Deferred@214689162 after retry RPC after error@1291265377) -> (continuation of Deferred@507813113 after retry RPC after error@2045177040) -> (continuation of Deferred@718447059 after retry RPC after error@1610307013) -> (continuation of Deferred@1700968855 after retry RPC after error@724322695) -> (continuation of Deferred@340764936 after retry RPC after error@287281977) -> (continuation of Deferred@1631661708 after retry RPC after error@677917522) -> (continuation of Deferred@1099356350 after retry RPC after error@745348588) -> (continuation of Deferred@1144026019 after retry RPC after error@766196436) -> (continuation of Deferred@1511998711 after retry RPC after error@509194277) -> (continuation of Deferred@1504929062 after retry RPC after error@758815070) -> (continuation of Deferred@228743410 after retry RPC after error@1579747835) -> (continuation of Deferred@485612877 after retry RPC after error@1710774244)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:11.222 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.223 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.223 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.224 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.224 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.224 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.225 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.226 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:13:11.227 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:13:11.236 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
12:13:11.236 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:13:11.237 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:11.238 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:13:11.238 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:11.242 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:13:11.242 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.243 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.243 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
12:13:11.243 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.244 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.244 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.244 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.246 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.246 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.246 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.246 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.252 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:13:11.252 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:13:11.252 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:13:11.252 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:13:11.253 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 7aeee9093f324ddcb4adc4ff322e3a04(127.11.220.3:44361)] disconnecting while in state TERMINATED
12:13:11.253 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state TERMINATED
12:13:11.253 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state TERMINATED
12:13:11.254 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state TERMINATED
12:13:11.254 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:11.256 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:13:11.257 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:13:11.257 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
12:13:11.262 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.263 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.263 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.264 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.264 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.265 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.267 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:11.267 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:13:11.267 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:11.269 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state TERMINATED
12:13:11.269 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state TERMINATED
12:13:11.269 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state TERMINATED
12:13:11.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:11.270 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:11.270 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:13:11.271 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:11.271 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:13:11.271 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:11.272 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:11.273 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:13:11.273 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:11.273 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state TERMINATED
12:13:11.273 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state TERMINATED
12:13:11.273 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state TERMINATED
12:13:11.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:11.274 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 5ab7ea72bb054c89adbb75260eb20139(127.11.220.1:40891)] disconnecting while in state TERMINATED
12:13:11.274 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.11.220.60:40605(127.11.220.60:40605)] disconnecting while in state TERMINATED
12:13:11.274 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:13:11.274 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.11.220.62:34269(127.11.220.62:34269)] disconnecting while in state TERMINATED
12:13:11.274 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.11.220.61:39401(127.11.220.61:39401)] disconnecting while in state TERMINATED
12:13:11.274 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:11.275 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:11.275 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:13:11.275 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-3
12:13:11.275 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:11.277 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:13:11.277 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:11.279 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:13:11.279 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:11.280 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
12:13:11.282 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.283 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.283 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.285 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.285 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.286 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.286 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:13:11.286 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:11.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.287 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:13:11.287 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:11.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.287 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.289 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:11.290 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:13:11.290 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:13:11.290 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:11.291 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:11.291 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:13:11.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:13:11.292 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:11.292 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:13:11.294 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
12:13:11.294 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:13:11.296 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:11.296 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:13:11.300 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:13:11.301 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:13:11.302 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.303 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.303 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.305 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.305 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.305 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.309 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:11.310 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:11.312 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:13:11.314 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:13:11.422 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.423 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.423 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.424 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.425 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.425 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.427 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.427 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.428 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.545651 14562 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:11.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.546218 14562 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:11.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.546764 14562 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:11.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.580072 14562 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:11.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.580893 14562 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.164.195
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.621093 14562 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.13.164.212:37869
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.13.164.195:0
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data/info.pb
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.13.164.195
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.13.164.254:45345,127.13.164.253:36317,127.13.164.252:40513
12:13:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.13.164.195
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/logs
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:11.622 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.622632 14562 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:11.623 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.623 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.624 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.624 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.624 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:11.624678 14562 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:11.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.626 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:11.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.638203 14589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:11.922 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:11.923 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:11.923 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.924 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.924 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.924 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:11.925 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:11.926 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.926 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:11.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:11.929 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:12.153633 14553 heartbeater.cc:499] Master 127.13.164.252:40513 was elected leader, sending a full tablet report...
12:13:12.275 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:13:12.279 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:13:12.299 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
12:13:12.299 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:13:12.303 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.303 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.304 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.305 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.305 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.305 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.310 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.310 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.310 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.312 [INFO - Thread-10] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:13:12.313 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:13:12.313 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:13:12.313 [DEBUG - Thread-10] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:13:12.314 [DEBUG - Thread-10] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:12.315 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:13:12.317 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:13:12.317 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:12.319 [INFO - Thread-10] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:13:12.323 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:13:12.328 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:12.330 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:13:12.332 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:13:12.334 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:12.337 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:13:12.337 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:13:12.337 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
12:13:12.338 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:13:12.339 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:13:12.341 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:12.343 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
12:13:12.343 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:13:12.343 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
12:13:12.344 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:12.346 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
12:13:12.346 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:13:12.346 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
12:13:12.347 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:13:12.348 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
12:13:12.348 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:13:12.350 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:12.350 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:12.350 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:12.350 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:12.351 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:13:12.353 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:13:12.358 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:13:12.359 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:13:12.360 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:13:12.361 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
12:13:12.361 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:13:12.363 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:13:12.366 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
12:13:12.367 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
12:13:12.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:13:12.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7838f014
12:13:12.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:12.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:12.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:13:12.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:13:12.374 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
12:13:12.374 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7c56f9fb
12:13:12.374 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:12.375 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:12.375 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:13:12.376 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
12:13:12.377 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e5936b3
12:13:12.377 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:12.377 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:12.378 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:13:12.380 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
12:13:12.381 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@776e08ee
12:13:12.381 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:12.381 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:12.382 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:13:12.384 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@22b4f30f
12:13:12.385 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:13:12.385 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:13:12.389 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@77548b44
12:13:12.404 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43f18cb7
12:13:12.404 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@53b34bf
12:13:12.404 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:13:12.416 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:12.427 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:12.431 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:12.433 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:12.440 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:12.448 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.450 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.453 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.454 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.457 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.462 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.464 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.465 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.498 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.498 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.498 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.500 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.500 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.500 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.503 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.505 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.505 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.505 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.507 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.514 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.521 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.525 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.525 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.528 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.536 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.536 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.544 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.546 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.547 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.547 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.548 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.548 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.549 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.550 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.551 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.551 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.555 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.562 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.567 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.567 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.567 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.568 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.573 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.573 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.573 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.576 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.585 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.586 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.586 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.586 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.587 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.587 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.587 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.589 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.589 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.593 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.594 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.597 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.597 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.598 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.601 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.601 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.602 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.606 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.608 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.609 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.610 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.618 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.618 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.618 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.618 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.621 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.626 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.630 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.630 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.632 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.632 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.632 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.635 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.637 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.638 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.638 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.638 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.641 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.642 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.642 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.642 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.645 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.648 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.648 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.648 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.654 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.654 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.655 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.655 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.656 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.656 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.657 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.658 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.659 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.660 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.661 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.661 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.661 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.663 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.663 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.665 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.666 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.667 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.672 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.672 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.672 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.673 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.673 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.674 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.674 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.674 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.674 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.674 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.675 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.675 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.675 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.675 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.676 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.676 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.676 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.676 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.680 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.681 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.681 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.685 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.685 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.686 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.686 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.689 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.690 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.691 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.691 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.691 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.692 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.692 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.693 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.693 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.693 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.693 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.695 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.695 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.696 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.696 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.697 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.698 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.698 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.698 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.700 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.700 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.701 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.702 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.702 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.702 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.702 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.703 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.703 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.703 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.703 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.706 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.708 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.708 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.708 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.710 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.710 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.711 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.711 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.711 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.712 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.712 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.712 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.713 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.714 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.714 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.715 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.715 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.715 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.715 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.716 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.716 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.716 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.716 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.716 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.716 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.717 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.717 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.717 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.717 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.717 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.717 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.718 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.718 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.718 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.718 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.730 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.730 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.730 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.730 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.730 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.731 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.731 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.733 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.731 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.733 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.734 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.734 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.734 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.734 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.734 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.734 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.734 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.735 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.735 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.735 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.736 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.736 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.737 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.740 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.741 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.741 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.742 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.742 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.742 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.743 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.743 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.743 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.744 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.744 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.744 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.749 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.750 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.750 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.750 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.750 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.750 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.751 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.751 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.751 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.751 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.754 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.755 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.755 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.756 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.769 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.769 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.770 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.770 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.770 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.770 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.770 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.770 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.770 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.770 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.771 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.771 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.771 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.772 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.773 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.773 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.774 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.774 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.774 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.774 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.774 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.774 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.770 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.774 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.775 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.775 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.775 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.789 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.790 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.790 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.790 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.790 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.791 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.792 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.792 [INFO - pool-36-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.792 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.793 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.793 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.794 [INFO - pool-36-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.794 [WARN - pool-36-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.795 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.795 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.795 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.797 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.797 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.797 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.797 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.821 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.822 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.822 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.824 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.870 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.871 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.871 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.873 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.873 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.876 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.876 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.876 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.876 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.894 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.894 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.895 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.897 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.897 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.897 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.897 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.915 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.916 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.917 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.918 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.918 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.918 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.918 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.919 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.929 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.929 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.930 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.930 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.931 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.931 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.931 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.931 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.931 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.931 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.932 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:12.941 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:12.941 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:12.941 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:12.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:12.943 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.943 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.943 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:12.943 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.943 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.944 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:12.944 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:12.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:12.953 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:12.954 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:12.954 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:12.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:12.956 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.956 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.956 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:12.956 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:12.957 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.010 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.011 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.011 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.011 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.011 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.012 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.012 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.012 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.012 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.012 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.012 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.013 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:11.639426 14590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:13.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:13.031874 14562 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.395s	user 0.524s	sys 0.767s
12:13:13.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:13.032236 14562 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.395s	user 0.524s	sys 0.767s
12:13:13.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.033948 14562 server_base.cc:1061] running on GCE node
12:13:13.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:13.035459 14651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:13.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.036847 14562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:13.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.039422 14562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:13.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.040855 14562 hybrid_clock.cc:648] HybridClock initialized: now 1783512793040736 us; error 93 us; skew 500 ppm
12:13:13.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.041918 14562 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:13.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.050477 14562 webserver.cc:533] Webserver started at http://127.13.164.195:38303/ using document root <none> and password file <none>
12:13:13.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.051756 14562 fs_manager.cc:362] Metadata directory not provided
12:13:13.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.052050 14562 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:13.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.052595 14562 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.058777 14562 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data/instance:
12:13:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c03677bb70fe49339876d767c1854656"
12:13:13.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:13 on dist-test-slave-vcgh"
12:13:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.060258 14562 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal/instance:
12:13:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c03677bb70fe49339876d767c1854656"
12:13:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:13 on dist-test-slave-vcgh"
12:13:13.073 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.074 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.074 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.074 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.077 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.088025 14562 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.013s	sys 0.013s
12:13:13.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.097296 14656 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:13.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.098845 14562 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.008s	sys 0.000s
12:13:13.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.099248 14562 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal
12:13:13.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c03677bb70fe49339876d767c1854656"
12:13:13.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:13 on dist-test-slave-vcgh"
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.099670 14562 fs_report.cc:389] FS layout report
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data/data
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:13.101 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:13.102 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:13.102 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:13.103 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.105 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.105 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.105 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.112 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.112 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.113 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.113 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:13.148 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.149 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.150 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.151 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.152 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.152 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.152 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.152 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.155 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.155 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.156 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.156 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.157 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.158 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.158 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.161 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:13.162 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:13.162 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:13.163 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.163 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.163 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.164 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.164 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.164 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.165 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.165 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:13.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.188894 14562 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.190342 14562 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.190757 14562 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.193861 14562 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.199288 14562 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.199479 14562 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:13.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.199666 14562 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:13.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.199796 14562 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:13.270 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.271 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.271 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.273 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.353319 14562 rpc_server.cc:307] RPC server started. Bound to: 127.13.164.195:38081
12:13:13.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.353418 14768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.164.195:38081 every 8 connection(s)
12:13:13.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.355876 14562 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/data/info.pb
12:13:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.357928 13971 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 14562
12:13:13.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.358354 13971 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster1331110111321052818/ts-2/wal/instance
12:13:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.408262 14769 heartbeater.cc:344] Connected to a master server at 127.13.164.253:36317
12:13:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.408799 14769 heartbeater.cc:461] Registering TS with master...
12:13:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.409605 14770 heartbeater.cc:344] Connected to a master server at 127.13.164.252:40513
12:13:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.409893 14770 heartbeater.cc:461] Registering TS with master...
12:13:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.410146 14769 heartbeater.cc:507] Master 127.13.164.253:36317 requested a full tablet report, sending...
12:13:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.410279 14771 heartbeater.cc:344] Connected to a master server at 127.13.164.254:45345
12:13:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.410581 14771 heartbeater.cc:461] Registering TS with master...
12:13:13.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.410995 14770 heartbeater.cc:507] Master 127.13.164.252:40513 requested a full tablet report, sending...
12:13:13.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.411415 14771 heartbeater.cc:507] Master 127.13.164.254:45345 requested a full tablet report, sending...
12:13:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.413599 14093 ts_manager.cc:194] Registered new tserver with Master: c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.413489 14172 ts_manager.cc:194] Registered new tserver with Master: c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:13.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.413756 14016 ts_manager.cc:194] Registered new tserver with Master: c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:13.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.415288 14172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.13.164.195:42655
12:13:13.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.430653 13971 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:13:13.444 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:13:13.444 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:13:13.445 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.164.254"
      port: 45345
    }
    bound_http_address {
      host: "127.13.164.254"
      port: 39269
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.164.253"
      port: 36317
    }
    bound_http_address {
      host: "127.13.164.253"
      port: 44327
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.164.252"
      port: 40513
    }
    bound_http_address {
      host: "127.13.164.252"
      port: 32895
    }
  }
}

12:13:13.446 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:13:13.447 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.13.164.193"
      port: 45803
    }
    bound_http_address {
      host: "127.13.164.193"
      port: 39585
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.13.164.194"
      port: 45355
    }
    bound_http_address {
      host: "127.13.164.194"
      port: 38355
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.13.164.195"
      port: 38081
    }
    bound_http_address {
      host: "127.13.164.195"
      port: 38303
    }
  }
}

12:13:13.447 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:13:13.449 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:13.451 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:13.456 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:13.457 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:13.459 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.238.254:35497(127.12.238.254:35497)] Successfully connected to peer
12:13:13.463 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:13.465 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.238.252:39469(127.12.238.252:39469)] Successfully connected to peer
12:13:13.465 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.254
12:13:13.470 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.471 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.471 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.238.253:35475(127.12.238.253:35475)] Successfully connected to peer
12:13:13.471 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.472 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.472 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.477 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.477 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.477 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.477 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.486 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.252
12:13:13.503 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:13.506 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.253
12:13:13.513 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6beb1b94, L:/127.0.0.1:41782 - R:/127.12.238.254:35497] using SASL/PLAIN
12:13:13.515 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:13.520 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1b367296, L:/127.0.0.1:53150 - R:/127.12.238.252:39469] using SASL/PLAIN
12:13:13.525 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:13.525 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=69), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: OK, deferred=null) after lookup
12:13:13.526 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:13.531 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd633616c, L:/127.0.0.1:51768 - R:/127.12.238.253:35475] using SASL/PLAIN
12:13:13.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.527823 13443 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53150:
12:13:13.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:13:13.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:13.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:13.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:13.534873 13443 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:13:13.603 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:13.615 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:13.616 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:13.617 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:13.617 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.617 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:13.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:13.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:13.619 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:13.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.680603 13612 tablet_service.cc:1511] Processing CreateTablet for tablet ebd236911db54f4bac13b7b9cbb4f652 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.684351 13612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd236911db54f4bac13b7b9cbb4f652. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.697041 13610 tablet_service.cc:1511] Processing CreateTablet for tablet e909236b061042d583fcc54c35a1ed89 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.698588 13610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e909236b061042d583fcc54c35a1ed89. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.702770 13611 tablet_service.cc:1511] Processing CreateTablet for tablet f074eebe7fc641aa82cd0f5a960efb46 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.679661 13609 tablet_service.cc:1511] Processing CreateTablet for tablet 590b08f86d964759845bbd0e012bf367 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.709760 13893 tablet_service.cc:1511] Processing CreateTablet for tablet e909236b061042d583fcc54c35a1ed89 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.711946 13893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e909236b061042d583fcc54c35a1ed89. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.713681 13891 tablet_service.cc:1511] Processing CreateTablet for tablet bd0762c6ba7e4d2e88b05e270a68ca72 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.715009 13891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0762c6ba7e4d2e88b05e270a68ca72. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.721616 13894 tablet_service.cc:1511] Processing CreateTablet for tablet f074eebe7fc641aa82cd0f5a960efb46 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.708077 13892 tablet_service.cc:1511] Processing CreateTablet for tablet 590b08f86d964759845bbd0e012bf367 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.722932 13894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f074eebe7fc641aa82cd0f5a960efb46. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.724165 13895 tablet_service.cc:1511] Processing CreateTablet for tablet ebd236911db54f4bac13b7b9cbb4f652 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.725500 13895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd236911db54f4bac13b7b9cbb4f652. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.726155 14806 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: Bootstrap starting.
12:13:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.679615 13608 tablet_service.cc:1511] Processing CreateTablet for tablet bd0762c6ba7e4d2e88b05e270a68ca72 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.704048 13611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f074eebe7fc641aa82cd0f5a960efb46. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.727465 13892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590b08f86d964759845bbd0e012bf367. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.728616 13609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590b08f86d964759845bbd0e012bf367. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.729739 13608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0762c6ba7e4d2e88b05e270a68ca72. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.767597 13753 tablet_service.cc:1511] Processing CreateTablet for tablet f074eebe7fc641aa82cd0f5a960efb46 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.775885 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f074eebe7fc641aa82cd0f5a960efb46. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.768646 13752 tablet_service.cc:1511] Processing CreateTablet for tablet e909236b061042d583fcc54c35a1ed89 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.786154 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e909236b061042d583fcc54c35a1ed89. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.769178 13751 tablet_service.cc:1511] Processing CreateTablet for tablet 590b08f86d964759845bbd0e012bf367 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.789099 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 590b08f86d964759845bbd0e012bf367. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.767370 13750 tablet_service.cc:1511] Processing CreateTablet for tablet bd0762c6ba7e4d2e88b05e270a68ca72 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.793604 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0762c6ba7e4d2e88b05e270a68ca72. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.792137 13754 tablet_service.cc:1511] Processing CreateTablet for tablet ebd236911db54f4bac13b7b9cbb4f652 (DEFAULT_TABLE table=replication_test_table [id=73237a28926d4473b710888f82fc2d93]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:13.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.797101 13754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd236911db54f4bac13b7b9cbb4f652. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:13.801 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:13.802 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:13.802 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:13.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:13.804 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.804 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.804 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:13.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:13.807 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:13.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.819512 14806 tablet_bootstrap.cc:654] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: Neither blocks nor log segments found. Creating new log.
12:13:13.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.823794 14806 log.cc:826] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: Log is configured to *not* fsync() on all Append() calls
12:13:13.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.827817 14807 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Bootstrap starting.
12:13:13.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.838783 14807 tablet_bootstrap.cc:654] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Neither blocks nor log segments found. Creating new log.
12:13:13.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.841058 14807 log.cc:826] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Log is configured to *not* fsync() on all Append() calls
12:13:13.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.857553 14807 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: No bootstrap required, opened a new log
12:13:13.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.858093 14807 ts_tablet_manager.cc:1403] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.005s
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.900573 14807 raft_consensus.cc:359] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.901547 14807 raft_consensus.cc:385] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.901827 14807 raft_consensus.cc:740] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Initialized, Role: FOLLOWER
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.902707 14807 consensus_queue.cc:260] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.903779 14806 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: No bootstrap required, opened a new log
12:13:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.904335 14806 ts_tablet_manager.cc:1403] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent bootstrapping tablet: real 0.179s	user 0.025s	sys 0.016s
12:13:13.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.914003 14807 ts_tablet_manager.cc:1434] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent starting tablet: real 0.056s	user 0.032s	sys 0.007s
12:13:13.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.933525 14807 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9: Bootstrap starting.
12:13:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.941835 14807 tablet_bootstrap.cc:654] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9: Neither blocks nor log segments found. Creating new log.
12:13:13.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.942164 14811 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Bootstrap starting.
12:13:13.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:13.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.951853 14811 tablet_bootstrap.cc:654] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Neither blocks nor log segments found. Creating new log.
12:13:13.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.954371 14811 log.cc:826] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Log is configured to *not* fsync() on all Append() calls
12:13:13.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.959307 14807 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9: No bootstrap required, opened a new log
12:13:13.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.960165 14807 ts_tablet_manager.cc:1403] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.008s
12:13:13.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.962167 14811 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: No bootstrap required, opened a new log
12:13:13.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.962662 14811 ts_tablet_manager.cc:1403] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Time spent bootstrapping tablet: real 0.021s	user 0.001s	sys 0.014s
12:13:13.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.962795 14807 raft_consensus.cc:359] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.962775 14806 raft_consensus.cc:359] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.963409 14807 raft_consensus.cc:385] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:13.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.963498 14806 raft_consensus.cc:385] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:13.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.963685 14807 raft_consensus.cc:740] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Initialized, Role: FOLLOWER
12:13:13.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.963743 14806 raft_consensus.cc:740] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Initialized, Role: FOLLOWER
12:13:13.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.964582 14807 consensus_queue.cc:260] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.964641 14806 consensus_queue.cc:260] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.968488 14806 ts_tablet_manager.cc:1434] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent starting tablet: real 0.063s	user 0.023s	sys 0.008s
12:13:13.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.969964 14806 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: Bootstrap starting.
12:13:13.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.976190 14806 tablet_bootstrap.cc:654] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: Neither blocks nor log segments found. Creating new log.
12:13:13.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.976536 14807 ts_tablet_manager.cc:1434] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
12:13:13.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.981730 14807 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9: Bootstrap starting.
12:13:13.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.987872 14806 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: No bootstrap required, opened a new log
12:13:13.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.988420 14806 ts_tablet_manager.cc:1403] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
12:13:13.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.989308 14807 tablet_bootstrap.cc:654] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9: Neither blocks nor log segments found. Creating new log.
12:13:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.991262 14806 raft_consensus.cc:359] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.991384 14811 raft_consensus.cc:359] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.992198 14806 raft_consensus.cc:385] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.992326 14811 raft_consensus.cc:385] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:13.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.992627 14811 raft_consensus.cc:740] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Initialized, Role: FOLLOWER
12:13:13.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.992676 14806 raft_consensus.cc:740] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Initialized, Role: FOLLOWER
12:13:13.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.993517 14806 consensus_queue.cc:260] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:13.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:13.993897 14811 consensus_queue.cc:260] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.002596 14806 ts_tablet_manager.cc:1434] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
12:13:14.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.007905 14806 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae: Bootstrap starting.
12:13:14.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.008785 14810 raft_consensus.cc:493] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.009438 14810 raft_consensus.cc:515] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.014454 14806 tablet_bootstrap.cc:654] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae: Neither blocks nor log segments found. Creating new log.
12:13:14.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.018405 13826 tablet.cc:2406] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:14.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.019658 14811 ts_tablet_manager.cc:1434] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d: Time spent starting tablet: real 0.057s	user 0.037s	sys 0.015s
12:13:14.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.020730 14811 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d: Bootstrap starting.
12:13:14.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.026847 14811 tablet_bootstrap.cc:654] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d: Neither blocks nor log segments found. Creating new log.
12:13:14.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.029554 14810 leader_election.cc:290] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:13:14.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.033434 14811 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d: No bootstrap required, opened a new log
12:13:14.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.033859 14811 ts_tablet_manager.cc:1403] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
12:13:14.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.033946 14807 tablet_bootstrap.cc:492] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9: No bootstrap required, opened a new log
12:13:14.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.034349 14807 ts_tablet_manager.cc:1403] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.019s
12:13:14.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.036367 14807 raft_consensus.cc:359] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.036901 14807 raft_consensus.cc:385] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.037158 14807 raft_consensus.cc:740] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Initialized, Role: FOLLOWER
12:13:14.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.037796 14807 consensus_queue.cc:260] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.039708 14807 ts_tablet_manager.cc:1434] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
12:13:14.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.036641 14811 raft_consensus.cc:359] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.041608 14811 raft_consensus.cc:385] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.040539 14807 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9: Bootstrap starting.
12:13:14.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.041879 14811 raft_consensus.cc:740] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Initialized, Role: FOLLOWER
12:13:14.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.042536 14811 consensus_queue.cc:260] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.048367 14807 tablet_bootstrap.cc:654] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9: Neither blocks nor log segments found. Creating new log.
12:13:14.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.051921 14806 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae: No bootstrap required, opened a new log
12:13:14.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.052516 14806 ts_tablet_manager.cc:1403] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.001s
12:13:14.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.056265 14806 raft_consensus.cc:359] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.057112 14806 raft_consensus.cc:385] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.057691 14806 raft_consensus.cc:740] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Initialized, Role: FOLLOWER
12:13:14.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.058739 14806 consensus_queue.cc:260] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.054685 14811 ts_tablet_manager.cc:1434] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
12:13:14.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.069231 13965 tablet.cc:2406] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:14.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.077648 14811 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d: Bootstrap starting.
12:13:14.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.080260 14814 raft_consensus.cc:493] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.080874 14814 raft_consensus.cc:515] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.093137 14814 leader_election.cc:290] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.097909 14806 ts_tablet_manager.cc:1434] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent starting tablet: real 0.045s	user 0.003s	sys 0.003s
12:13:14.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.107543 14811 tablet_bootstrap.cc:654] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d: Neither blocks nor log segments found. Creating new log.
12:13:14.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.112138 14806 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae: Bootstrap starting.
12:13:14.114 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.114 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.115 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.117 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.118 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.118 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.118 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.118 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.118 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.118357 14807 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9: No bootstrap required, opened a new log
12:13:14.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.118767 14807 ts_tablet_manager.cc:1403] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.042s
12:13:14.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.113580 13682 tablet.cc:2406] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:14.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.113487 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.121395 14807 raft_consensus.cc:359] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.122016 14807 raft_consensus.cc:385] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.122283 14807 raft_consensus.cc:740] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Initialized, Role: FOLLOWER
12:13:14.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.122941 14807 consensus_queue.cc:260] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.128149 13848 leader_election.cc:343] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.129794 14806 tablet_bootstrap.cc:654] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae: Neither blocks nor log segments found. Creating new log.
12:13:14.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.131783 14817 raft_consensus.cc:493] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.132362 14817 raft_consensus.cc:515] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.134814 14807 ts_tablet_manager.cc:1434] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
12:13:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.138967 14807 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9: Bootstrap starting.
12:13:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.139387 14806 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae: No bootstrap required, opened a new log
12:13:14.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.139784 14806 ts_tablet_manager.cc:1403] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
12:13:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.141418 14817 leader_election.cc:290] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.142271 14806 raft_consensus.cc:359] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.142915 14806 raft_consensus.cc:385] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.143201 14806 raft_consensus.cc:740] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Initialized, Role: FOLLOWER
12:13:14.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.144026 14806 consensus_queue.cc:260] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.146425 14806 ts_tablet_manager.cc:1434] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
12:13:14.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.146836 14807 tablet_bootstrap.cc:654] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9: Neither blocks nor log segments found. Creating new log.
12:13:14.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.147488 14806 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae: Bootstrap starting.
12:13:14.150 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.151 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.151 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.154366 14806 tablet_bootstrap.cc:654] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae: Neither blocks nor log segments found. Creating new log.
12:13:14.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.160280 14807 tablet_bootstrap.cc:492] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9: No bootstrap required, opened a new log
12:13:14.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.160660 14807 ts_tablet_manager.cc:1403] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
12:13:14.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.162712 14810 raft_consensus.cc:493] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.163127 14810 raft_consensus.cc:515] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.163872 14806 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae: No bootstrap required, opened a new log
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.164245 14806 ts_tablet_manager.cc:1403] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.007s
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.164965 14810 leader_election.cc:290] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.165902 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.165918 14807 raft_consensus.cc:359] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.166546 14807 raft_consensus.cc:385] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.166498 13632 raft_consensus.cc:2468] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 0.
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.166807 14807 raft_consensus.cc:740] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Initialized, Role: FOLLOWER
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.166810 14806 raft_consensus.cc:359] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.167446 14806 raft_consensus.cc:385] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.167716 14806 raft_consensus.cc:740] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Initialized, Role: FOLLOWER
12:13:14.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.167430 14807 consensus_queue.cc:260] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.167727 13848 leader_election.cc:304] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 
12:13:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.168609 14810 raft_consensus.cc:2804] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.168517 14806 consensus_queue.cc:260] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.169016 14810 raft_consensus.cc:493] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.169317 14810 raft_consensus.cc:3060] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Advancing to term 1
12:13:14.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.170855 14806 ts_tablet_manager.cc:1434] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
12:13:14.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.171 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.171 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.171 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.172 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.172 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.172 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.172 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.178483 14810 raft_consensus.cc:515] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.180286 14810 leader_election.cc:290] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 election: Requested vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:13:14.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.183650 14810 raft_consensus.cc:493] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.184047 14810 raft_consensus.cc:515] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.185446 14807 ts_tablet_manager.cc:1434] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
12:13:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.186658 14810 leader_election.cc:290] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:13:14.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.187377 13631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.188030 13631 raft_consensus.cc:2468] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 0.
12:13:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.190012 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:13:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.190557 13632 raft_consensus.cc:3060] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Advancing to term 1
12:13:14.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.196529 13848 leader_election.cc:304] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 
12:13:14.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.201575 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.202581 13915 raft_consensus.cc:2393] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1453da96a7f74ffcb7c36fb05288897d in current term 1: Already voted for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in this term.
12:13:14.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.202668 13631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.203855 14810 raft_consensus.cc:2804] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.204170 14810 raft_consensus.cc:493] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.204481 14810 raft_consensus.cc:3060] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Advancing to term 1
12:13:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.204347 13707 leader_election.cc:304] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1453da96a7f74ffcb7c36fb05288897d; no voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9
12:13:14.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.208343 14817 raft_consensus.cc:3060] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Advancing to term 1
12:13:14.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.210187 14810 raft_consensus.cc:515] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.211462 14810 leader_election.cc:290] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 election: Requested vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781)
12:13:14.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.213735 13631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:13:14.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.214250 13631 raft_consensus.cc:3060] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Advancing to term 1
12:13:14.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.214753 14817 raft_consensus.cc:2749] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:14.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.222113 13631 raft_consensus.cc:2468] T f074eebe7fc641aa82cd0f5a960efb46 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 1.
12:13:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.226958 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.227692 13915 raft_consensus.cc:2393] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c9ee0fd08004f7d883e3a7b945f92ae in current term 1: Already voted for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in this term.
12:13:14.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.227861 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.230348 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.230907 13774 raft_consensus.cc:2468] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 1.
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.232311 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.232945 13772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.232890 13773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd236911db54f4bac13b7b9cbb4f652" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.234958 13773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.235968 13848 leader_election.cc:343] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.229092 13632 raft_consensus.cc:2468] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 1.
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.235090 13565 leader_election.cc:304] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae; no voters: 1453da96a7f74ffcb7c36fb05288897d, 2b922a4a5f4548ec9bece88a0923e4b9
12:13:14.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.236368 13848 leader_election.cc:304] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 1453da96a7f74ffcb7c36fb05288897d
12:13:14.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.237901 13848 leader_election.cc:343] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.237959 14814 raft_consensus.cc:2749] T ebd236911db54f4bac13b7b9cbb4f652 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:14.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.238664 13848 leader_election.cc:343] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.239274 13848 leader_election.cc:304] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 1453da96a7f74ffcb7c36fb05288897d
12:13:14.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.239928 13774 raft_consensus.cc:2468] T ebd236911db54f4bac13b7b9cbb4f652 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b922a4a5f4548ec9bece88a0923e4b9 in term 1.
12:13:14.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.240067 14834 raft_consensus.cc:2749] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.240710 14834 raft_consensus.cc:2804] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader election won for term 1
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.241125 14834 raft_consensus.cc:697] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 LEADER]: Becoming Leader. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Running, Role: LEADER
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.242004 14834 consensus_queue.cc:237] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.242928 14814 raft_consensus.cc:493] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.243307 14814 raft_consensus.cc:515] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.246299 14814 leader_election.cc:290] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.247917 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0762c6ba7e4d2e88b05e270a68ca72" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.248826 13848 leader_election.cc:304] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1453da96a7f74ffcb7c36fb05288897d, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 
12:13:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.249176 13565 leader_election.cc:343] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.250092 14810 raft_consensus.cc:2804] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader election won for term 1
12:13:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.252839 14811 tablet_bootstrap.cc:492] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d: No bootstrap required, opened a new log
12:13:14.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.253250 14811 ts_tablet_manager.cc:1403] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d: Time spent bootstrapping tablet: real 0.176s	user 0.007s	sys 0.005s
12:13:14.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.255700 14810 raft_consensus.cc:697] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 LEADER]: Becoming Leader. State: Replica: 2b922a4a5f4548ec9bece88a0923e4b9, State: Running, Role: LEADER
12:13:14.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.256538 14810 consensus_queue.cc:237] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.261816 14811 raft_consensus.cc:359] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.264334 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0762c6ba7e4d2e88b05e270a68ca72" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.264886 13915 raft_consensus.cc:2468] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c9ee0fd08004f7d883e3a7b945f92ae in term 0.
12:13:14.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.271106 13444 catalog_manager.cc:5697] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195). New cstate: current_term: 1 leader_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } health_report { overall_health: HEALTHY } } }
12:13:14.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.262449 14811 raft_consensus.cc:385] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.275180 14811 raft_consensus.cc:740] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Initialized, Role: FOLLOWER
12:13:14.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.274529 13567 leader_election.cc:304] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 1453da96a7f74ffcb7c36fb05288897d
12:13:14.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.276124 14836 raft_consensus.cc:2804] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:14.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.275990 14811 consensus_queue.cc:260] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.276492 14836 raft_consensus.cc:493] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:14.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.276862 14836 raft_consensus.cc:3060] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Advancing to term 1
12:13:14.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.280403 14811 ts_tablet_manager.cc:1434] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
12:13:14.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.281342 14811 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d: Bootstrap starting.
12:13:14.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.283658 14836 raft_consensus.cc:515] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.286821 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0762c6ba7e4d2e88b05e270a68ca72" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:13:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.287385 14811 tablet_bootstrap.cc:654] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d: Neither blocks nor log segments found. Creating new log.
12:13:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:14.288045 13565 leader_election.cc:343] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781): Illegal state: must be running to vote when last-logged opid is not known
12:13:14.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.289059 14836 leader_election.cc:290] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 election: Requested vote from peers 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.290709 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0762c6ba7e4d2e88b05e270a68ca72" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.291266 13915 raft_consensus.cc:3060] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Advancing to term 1
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.290786 14814 raft_consensus.cc:493] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.291653 14814 raft_consensus.cc:515] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.293509 14814 leader_election.cc:290] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.294207 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d" is_pre_election: true
12:13:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.294741 13774 raft_consensus.cc:2468] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c9ee0fd08004f7d883e3a7b945f92ae in term 0.
12:13:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.295840 13565 leader_election.cc:304] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 1453da96a7f74ffcb7c36fb05288897d; no voters: 
12:13:14.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.296522 14814 raft_consensus.cc:2804] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:14.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.296841 14814 raft_consensus.cc:493] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:14.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.297125 14814 raft_consensus.cc:3060] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Advancing to term 1
12:13:14.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.302783 14814 raft_consensus.cc:515] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.304291 14814 leader_election.cc:290] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 election: Requested vote from peers 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194:41781), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.304958 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1453da96a7f74ffcb7c36fb05288897d"
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.305426 13774 raft_consensus.cc:3060] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Advancing to term 1
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.305501 13914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.305989 13913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "590b08f86d964759845bbd0e012bf367" candidate_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:13:14.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.306231 13914 raft_consensus.cc:2468] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c9ee0fd08004f7d883e3a7b945f92ae in term 0.
12:13:14.309 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.309592 14811 tablet_bootstrap.cc:492] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d: No bootstrap required, opened a new log
12:13:14.310 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.310 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.310 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.310 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.310 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.311203 13774 raft_consensus.cc:2468] T 590b08f86d964759845bbd0e012bf367 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c9ee0fd08004f7d883e3a7b945f92ae in term 1.
12:13:14.312 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.312 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.312 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.312 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.312335 13565 leader_election.cc:304] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 1453da96a7f74ffcb7c36fb05288897d; no voters: 
12:13:14.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.312728 14811 ts_tablet_manager.cc:1403] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
12:13:14.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.314356 13915 raft_consensus.cc:2468] T bd0762c6ba7e4d2e88b05e270a68ca72 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c9ee0fd08004f7d883e3a7b945f92ae in term 1.
12:13:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.314731 14811 raft_consensus.cc:359] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.315237 14811 raft_consensus.cc:385] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.315469 14811 raft_consensus.cc:740] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Initialized, Role: FOLLOWER
12:13:14.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.315420 13567 leader_election.cc:304] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 1453da96a7f74ffcb7c36fb05288897d
12:13:14.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.316162 14814 raft_consensus.cc:2804] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader election won for term 1
12:13:14.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.316151 14836 raft_consensus.cc:2804] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader election won for term 1
12:13:14.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.318966 14814 raft_consensus.cc:697] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 LEADER]: Becoming Leader. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Running, Role: LEADER
12:13:14.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.320024 14814 consensus_queue.cc:237] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.324982 14817 raft_consensus.cc:493] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.325459 14817 raft_consensus.cc:515] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.327473 14817 leader_election.cc:290] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.329578 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e909236b061042d583fcc54c35a1ed89" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.317605 14811 consensus_queue.cc:260] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.330243 13632 raft_consensus.cc:2468] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1453da96a7f74ffcb7c36fb05288897d in term 0.
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.331434 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e909236b061042d583fcc54c35a1ed89" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.332023 13915 raft_consensus.cc:2468] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1453da96a7f74ffcb7c36fb05288897d in term 0.
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.333520 13709 leader_election.cc:304] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1453da96a7f74ffcb7c36fb05288897d, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.338769 14817 raft_consensus.cc:2804] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.339135 14817 raft_consensus.cc:493] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.339460 14817 raft_consensus.cc:3060] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Advancing to term 1
12:13:14.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.347827 14817 raft_consensus.cc:515] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.332135 14811 ts_tablet_manager.cc:1434] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
12:13:14.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.365428 14811 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d: Bootstrap starting.
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.370790 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e909236b061042d583fcc54c35a1ed89" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae"
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.371378 13632 raft_consensus.cc:3060] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 0 FOLLOWER]: Advancing to term 1
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.371567 14817 leader_election.cc:290] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 election: Requested vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.376235 14811 tablet_bootstrap.cc:654] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d: Neither blocks nor log segments found. Creating new log.
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.382503 14836 raft_consensus.cc:697] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 LEADER]: Becoming Leader. State: Replica: 0c9ee0fd08004f7d883e3a7b945f92ae, State: Running, Role: LEADER
12:13:14.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.382063 13444 catalog_manager.cc:5697] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193). New cstate: current_term: 1 leader_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } health_report { overall_health: UNKNOWN } } }
12:13:14.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.383294 14836 consensus_queue.cc:237] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.385969 13915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e909236b061042d583fcc54c35a1ed89" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9"
12:13:14.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.386487 13915 raft_consensus.cc:3060] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Advancing to term 1
12:13:14.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.389489 13443 catalog_manager.cc:5697] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195). New cstate: current_term: 1 leader_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } health_report { overall_health: HEALTHY } } }
12:13:14.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.398859 14811 tablet_bootstrap.cc:492] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d: No bootstrap required, opened a new log
12:13:14.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.399269 14811 ts_tablet_manager.cc:1403] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.003s
12:13:14.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.401772 14811 raft_consensus.cc:359] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.402395 14811 raft_consensus.cc:385] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.402355 13632 raft_consensus.cc:2468] T e909236b061042d583fcc54c35a1ed89 P 0c9ee0fd08004f7d883e3a7b945f92ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1453da96a7f74ffcb7c36fb05288897d in term 1.
12:13:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.402657 14811 raft_consensus.cc:740] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Initialized, Role: FOLLOWER
12:13:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.403393 14811 consensus_queue.cc:260] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.404721 13915 raft_consensus.cc:2468] T e909236b061042d583fcc54c35a1ed89 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1453da96a7f74ffcb7c36fb05288897d in term 1.
12:13:14.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.405764 14811 ts_tablet_manager.cc:1434] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
12:13:14.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.405862 13709 leader_election.cc:304] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1453da96a7f74ffcb7c36fb05288897d, 2b922a4a5f4548ec9bece88a0923e4b9; no voters: 
12:13:14.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.406551 14817 raft_consensus.cc:2804] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 1 FOLLOWER]: Leader election won for term 1
12:13:14.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.419274 14770 heartbeater.cc:499] Master 127.13.164.252:40513 was elected leader, sending a full tablet report...
12:13:14.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.421643 14817 raft_consensus.cc:697] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [term 1 LEADER]: Becoming Leader. State: Replica: 1453da96a7f74ffcb7c36fb05288897d, State: Running, Role: LEADER
12:13:14.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.422993 14817 consensus_queue.cc:237] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.444092 13442 catalog_manager.cc:5697] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193). New cstate: current_term: 1 leader_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } health_report { overall_health: UNKNOWN } } }
12:13:14.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:14.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.455816 13443 catalog_manager.cc:5697] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1453da96a7f74ffcb7c36fb05288897d (127.12.238.194). New cstate: current_term: 1 leader_uuid: "1453da96a7f74ffcb7c36fb05288897d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } health_report { overall_health: UNKNOWN } } }
12:13:14.495 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.496 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.496 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.497 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.497 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.497 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.498 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.498 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.499 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.500 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.500 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.500 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.574 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.574 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.575 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.575 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.575 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.575 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.575 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.575 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.685626 14810 consensus_queue.cc:1048] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.704063 14838 consensus_queue.cc:1048] T ebd236911db54f4bac13b7b9cbb4f652 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.715134 13774 raft_consensus.cc:3060] T bd0762c6ba7e4d2e88b05e270a68ca72 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Advancing to term 1
12:13:14.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.723343 14836 consensus_queue.cc:1048] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.739643 14838 consensus_queue.cc:1048] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.749444 14836 consensus_queue.cc:1048] T bd0762c6ba7e4d2e88b05e270a68ca72 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.764649 14817 raft_consensus.cc:493] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:14.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.765123 14817 raft_consensus.cc:515] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 } } peers { permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 } } peers { permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 } }
12:13:14.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.766916 14817 leader_election.cc:290] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9ee0fd08004f7d883e3a7b945f92ae (127.12.238.193:33745), 2b922a4a5f4548ec9bece88a0923e4b9 (127.12.238.195:41959)
12:13:14.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.768527 13913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" is_pre_election: true
12:13:14.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.771165 13632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f074eebe7fc641aa82cd0f5a960efb46" candidate_uuid: "1453da96a7f74ffcb7c36fb05288897d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" is_pre_election: true
12:13:14.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.772396 13707 leader_election.cc:304] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1453da96a7f74ffcb7c36fb05288897d; no voters: 0c9ee0fd08004f7d883e3a7b945f92ae, 2b922a4a5f4548ec9bece88a0923e4b9
12:13:14.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.774323 14817 raft_consensus.cc:2749] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:14.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.775 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.776 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.776 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.777 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.777 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.777 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.777 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.804337 13774 raft_consensus.cc:3060] T f074eebe7fc641aa82cd0f5a960efb46 P 1453da96a7f74ffcb7c36fb05288897d [term 0 FOLLOWER]: Advancing to term 1
12:13:14.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.815478 14834 consensus_queue.cc:1048] T f074eebe7fc641aa82cd0f5a960efb46 P 2b922a4a5f4548ec9bece88a0923e4b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.829 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.829 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.830 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.830 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.830 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.830 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.830 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.830 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.831 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.831 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.831 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.831 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.849082 14814 consensus_queue.cc:1048] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "1453da96a7f74ffcb7c36fb05288897d" member_type: VOTER last_known_addr { host: "127.12.238.194" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.876395 13915 raft_consensus.cc:3060] T 590b08f86d964759845bbd0e012bf367 P 2b922a4a5f4548ec9bece88a0923e4b9 [term 0 FOLLOWER]: Advancing to term 1
12:13:14.880 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.883 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.884 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.885 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.888074 14817 consensus_queue.cc:1048] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c9ee0fd08004f7d883e3a7b945f92ae" member_type: VOTER last_known_addr { host: "127.12.238.193" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.891991 14843 consensus_queue.cc:1048] T 590b08f86d964759845bbd0e012bf367 P 0c9ee0fd08004f7d883e3a7b945f92ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:14.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:14.903975 14852 consensus_queue.cc:1048] T e909236b061042d583fcc54c35a1ed89 P 1453da96a7f74ffcb7c36fb05288897d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b922a4a5f4548ec9bece88a0923e4b9" member_type: VOTER last_known_addr { host: "127.12.238.195" port: 41959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:13:14.911 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.911 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.912 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.912 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.913 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.913 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.913 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.913 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.917 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.917 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.918 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.934 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:14.935 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:14.935 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:14.936 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.936 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.936 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:14.937 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.937 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.937 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:14.938 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.938 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.938 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:14.938 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:14.952 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:14.960 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:14.969 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:14.971 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:14.971 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:14.972 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:14.972 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:14.972 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=11), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC GetTableLocations: received response from server master-127.12.238.252:39469: OK, deferred=null) after lookup
12:13:14.973 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:14.975 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:14.989 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:14.993 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x47cbd27b, L:/127.0.0.1:55026 - R:/127.12.238.195:41959] using TOKEN/null
12:13:15.010 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:15.010 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:15.011 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:15.011 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.011 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.011 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.012 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:15.023 [DEBUG - main] (Connection.java:748) [peer 0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)] connecting to peer
12:13:15.024 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)] Successfully connected to peer
12:13:15.038 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.041 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xe31b65c4, L:/127.0.0.1:53768 - R:/127.12.238.193:33745] using TOKEN/null
12:13:15.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:15.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:15.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:15.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:15.065 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:15.065 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:15.065 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.238.252:39469, [5ms] Sub RPC GetTableLocations: received response from server master-127.12.238.252:39469: OK, deferred=null) after lookup
12:13:15.109 [DEBUG - main] (Connection.java:748) [peer 1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)] connecting to peer
12:13:15.111 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)] Successfully connected to peer
12:13:15.123 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.129 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xd736e7d1, L:/127.0.0.1:55192 - R:/127.12.238.194:41781] using TOKEN/null
12:13:15.252 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:15.253 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:15.255 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:15.256 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:15.256 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:15.265 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:15.266 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:15.267 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:15.277 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:15.278 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.281 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:15.293 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.295 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:15.296 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe12256f5, L:/127.0.0.1:37574 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:15.302 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x36bf6d19, L:/127.0.0.1:57464 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:15.306 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:15.306 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=52), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:15.309 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:15.311 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.313 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc99f7faf, L:/127.0.0.1:60218 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:15.317 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:15.318 [DEBUG - main] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:15.318 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.238.254:35497(127.12.238.254:35497)] Successfully connected to peer
12:13:15.321 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.238.252:39469(127.12.238.252:39469)] Successfully connected to peer
12:13:15.327 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.238.253:35475(127.12.238.253:35475)] Successfully connected to peer
12:13:15.335 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.252
12:13:15.348 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.253
12:13:15.353 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.254
12:13:15.359 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.364 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.369 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc40a0baf, L:/127.0.0.1:41784 - R:/127.12.238.254:35497] using SASL/PLAIN
12:13:15.371 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9f941b9d, L:/127.0.0.1:53160 - R:/127.12.238.252:39469] using SASL/PLAIN
12:13:15.375 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:15.375 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=66), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: OK, deferred=null) after lookup
12:13:15.378 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:15.385 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:15.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:15.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:15.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:15.386 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:15.386 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.390074 14172 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57464:
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   custom_hash_schema_ranges {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     range_bounds {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     hash_schema {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       columns {
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)         name: "key1"
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       }
12:13:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       num_buckets: 5
12:13:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       seed: 123
12:13:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:13:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:13:15.394 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:15.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:15.395675 14172 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:13:15.398 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5e2f368b, L:/127.0.0.1:51772 - R:/127.12.238.253:35475] using SASL/PLAIN
12:13:15.446 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:15.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:15.461 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:15.461 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:15.461 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:15.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:15.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:15.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:15.464 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:15.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:15.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:15.465 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:15.465 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:15.465 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:15.465 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:15.495 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:15.497 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.497 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.497 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:15.504 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:15.505 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:15.505 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:15.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:15.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:15.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.510316 14485 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba1d88f33479592499622388203ba (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.511857 14485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba1d88f33479592499622388203ba. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.514283 14484 tablet_service.cc:1511] Processing CreateTablet for tablet db06082c4313457fbbf84101e22144c2 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.515434 14484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db06082c4313457fbbf84101e22144c2. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.519459 14486 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3e15185749fbbed7d50575e0af6a (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.520633 14486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3e15185749fbbed7d50575e0af6a. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.526119 14487 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8c303050444b978d2ca60d12cf6663 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.527400 14487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8c303050444b978d2ca60d12cf6663. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.507529 14483 tablet_service.cc:1511] Processing CreateTablet for tablet 879efd1361794a50a103929e547b582d (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.531591 14483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879efd1361794a50a103929e547b582d. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.618595 14346 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8c303050444b978d2ca60d12cf6663 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.620633 14342 tablet_service.cc:1511] Processing CreateTablet for tablet 879efd1361794a50a103929e547b582d (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.622164 14342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879efd1361794a50a103929e547b582d. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.620416 14702 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba1d88f33479592499622388203ba (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.621361 14704 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8c303050444b978d2ca60d12cf6663 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 0, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.623586 14343 tablet_service.cc:1511] Processing CreateTablet for tablet db06082c4313457fbbf84101e22144c2 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.624068 14702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba1d88f33479592499622388203ba. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.624053 14701 tablet_service.cc:1511] Processing CreateTablet for tablet db06082c4313457fbbf84101e22144c2 (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 3, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.617910 14344 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba1d88f33479592499622388203ba (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 2, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.625890 14343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db06082c4313457fbbf84101e22144c2. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.626475 14346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8c303050444b978d2ca60d12cf6663. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.621320 14700 tablet_service.cc:1511] Processing CreateTablet for tablet 879efd1361794a50a103929e547b582d (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 4, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.632891 14704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8c303050444b978d2ca60d12cf6663. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.637449 14344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba1d88f33479592499622388203ba. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.625798 14703 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3e15185749fbbed7d50575e0af6a (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.639381 14700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879efd1361794a50a103929e547b582d. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.612461 14345 tablet_service.cc:1511] Processing CreateTablet for tablet e38f3e15185749fbbed7d50575e0af6a (DEFAULT_TABLE table=replication_test_table [id=7ee4dd18a5f04268a3cc94494e82d299]), partition=HASH (key1) PARTITION 1, RANGE (key1) PARTITION 100 <= VALUES < 200
12:13:15.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.643693 14345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3e15185749fbbed7d50575e0af6a. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.645538 14703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e38f3e15185749fbbed7d50575e0af6a. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.650534 14701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db06082c4313457fbbf84101e22144c2. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:15.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.666672 14911 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Bootstrap starting.
12:13:15.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.686542 14912 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: Bootstrap starting.
12:13:15.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.694864 14912 tablet_bootstrap.cc:654] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: Neither blocks nor log segments found. Creating new log.
12:13:15.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.697131 14912 log.cc:826] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: Log is configured to *not* fsync() on all Append() calls
12:13:15.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.705257 14911 tablet_bootstrap.cc:654] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Neither blocks nor log segments found. Creating new log.
12:13:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.706988 14914 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Bootstrap starting.
12:13:15.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.707396 14911 log.cc:826] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Log is configured to *not* fsync() on all Append() calls
12:13:15.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.716044 14914 tablet_bootstrap.cc:654] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Neither blocks nor log segments found. Creating new log.
12:13:15.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.718686 14914 log.cc:826] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Log is configured to *not* fsync() on all Append() calls
12:13:15.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.726715 14912 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: No bootstrap required, opened a new log
12:13:15.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.727255 14912 ts_tablet_manager.cc:1403] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.013s
12:13:15.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.729027 14911 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: No bootstrap required, opened a new log
12:13:15.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.729664 14911 ts_tablet_manager.cc:1403] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.006s
12:13:15.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.733935 14914 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: No bootstrap required, opened a new log
12:13:15.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.734519 14914 ts_tablet_manager.cc:1403] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
12:13:15.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.761636 14912 raft_consensus.cc:359] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.762642 14912 raft_consensus.cc:385] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.762920 14912 raft_consensus.cc:740] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03677bb70fe49339876d767c1854656, State: Initialized, Role: FOLLOWER
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.763948 14912 consensus_queue.cc:260] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.764055 14914 raft_consensus.cc:359] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.764928 14914 raft_consensus.cc:385] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.765201 14914 raft_consensus.cc:740] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Initialized, Role: FOLLOWER
12:13:15.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.766232 14914 consensus_queue.cc:260] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.774420 14914 ts_tablet_manager.cc:1434] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Time spent starting tablet: real 0.039s	user 0.030s	sys 0.003s
12:13:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.775560 14914 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2: Bootstrap starting.
12:13:15.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.792325 14912 ts_tablet_manager.cc:1434] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656: Time spent starting tablet: real 0.065s	user 0.037s	sys 0.003s
12:13:15.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.794572 14914 tablet_bootstrap.cc:654] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2: Neither blocks nor log segments found. Creating new log.
12:13:15.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.795281 14912 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: Bootstrap starting.
12:13:15.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.805434 14912 tablet_bootstrap.cc:654] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: Neither blocks nor log segments found. Creating new log.
12:13:15.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.811748 14914 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2: No bootstrap required, opened a new log
12:13:15.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.812462 14914 ts_tablet_manager.cc:1403] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.004s
12:13:15.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.815264 14914 raft_consensus.cc:359] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.816144 14914 raft_consensus.cc:385] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.816519 14914 raft_consensus.cc:740] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Initialized, Role: FOLLOWER
12:13:15.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.817394 14914 consensus_queue.cc:260] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.822088 14914 ts_tablet_manager.cc:1434] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
12:13:15.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.823098 14914 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2: Bootstrap starting.
12:13:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.824339 14911 raft_consensus.cc:359] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.825235 14911 raft_consensus.cc:385] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.825533 14911 raft_consensus.cc:740] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca778b17fc924aba9d167da2ededa2a2, State: Initialized, Role: FOLLOWER
12:13:15.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.827003 14912 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: No bootstrap required, opened a new log
12:13:15.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.826592 14911 consensus_queue.cc:260] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.827425 14912 ts_tablet_manager.cc:1403] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.003s
12:13:15.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.830376 14914 tablet_bootstrap.cc:654] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2: Neither blocks nor log segments found. Creating new log.
12:13:15.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.831465 14912 raft_consensus.cc:359] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:15.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.832105 14912 raft_consensus.cc:385] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.832367 14912 raft_consensus.cc:740] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03677bb70fe49339876d767c1854656, State: Initialized, Role: FOLLOWER
12:13:15.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.835574 14912 consensus_queue.cc:260] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:15.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:15.836438 14421 tablet.cc:2406] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:15.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.838253 14912 ts_tablet_manager.cc:1434] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.006s
12:13:15.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.841416 14912 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656: Bootstrap starting.
12:13:15.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.848464 14911 ts_tablet_manager.cc:1434] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Time spent starting tablet: real 0.119s	user 0.033s	sys 0.010s
12:13:15.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.849498 14911 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2: Bootstrap starting.
12:13:15.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.856634 14911 tablet_bootstrap.cc:654] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2: Neither blocks nor log segments found. Creating new log.
12:13:15.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.870492 14912 tablet_bootstrap.cc:654] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656: Neither blocks nor log segments found. Creating new log.
12:13:15.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.872103 14911 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2: No bootstrap required, opened a new log
12:13:15.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.872762 14911 ts_tablet_manager.cc:1403] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
12:13:15.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.875789 14911 raft_consensus.cc:359] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.876699 14911 raft_consensus.cc:385] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.877102 14911 raft_consensus.cc:740] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca778b17fc924aba9d167da2ededa2a2, State: Initialized, Role: FOLLOWER
12:13:15.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.877908 14911 consensus_queue.cc:260] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.880497 14911 ts_tablet_manager.cc:1434] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
12:13:15.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.881529 14911 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2: Bootstrap starting.
12:13:15.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.892560 14911 tablet_bootstrap.cc:654] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2: Neither blocks nor log segments found. Creating new log.
12:13:15.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:15.895290 14772 tablet.cc:2406] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.903330 14912 tablet_bootstrap.cc:492] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656: No bootstrap required, opened a new log
12:13:15.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.903759 14912 ts_tablet_manager.cc:1403] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656: Time spent bootstrapping tablet: real 0.063s	user 0.004s	sys 0.011s
12:13:15.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.905164 14911 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2: No bootstrap required, opened a new log
12:13:15.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.905759 14911 ts_tablet_manager.cc:1403] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
12:13:15.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.908562 14911 raft_consensus.cc:359] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.909382 14917 raft_consensus.cc:493] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:15.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.909498 14911 raft_consensus.cc:385] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.909924 14911 raft_consensus.cc:740] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca778b17fc924aba9d167da2ededa2a2, State: Initialized, Role: FOLLOWER
12:13:15.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.909950 14917 raft_consensus.cc:515] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:15.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.910687 14912 raft_consensus.cc:359] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.911345 14912 raft_consensus.cc:385] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.910943 14911 consensus_queue.cc:260] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.911608 14912 raft_consensus.cc:740] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03677bb70fe49339876d767c1854656, State: Initialized, Role: FOLLOWER
12:13:15.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.913749 14911 ts_tablet_manager.cc:1434] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
12:13:15.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:15.919983 14124 debug-util.cc:398] Leaking SignalData structure 0x7b0800079720 after lost signal to thread 14057
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.922093 14914 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2: No bootstrap required, opened a new log
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.922544 14914 ts_tablet_manager.cc:1403] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2: Time spent bootstrapping tablet: real 0.100s	user 0.035s	sys 0.050s
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.925261 14914 raft_consensus.cc:359] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.925920 14914 raft_consensus.cc:385] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.926252 14914 raft_consensus.cc:740] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Initialized, Role: FOLLOWER
12:13:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.927095 14914 consensus_queue.cc:260] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.929423 14914 ts_tablet_manager.cc:1434] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
12:13:15.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.930245 14911 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2: Bootstrap starting.
12:13:15.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.933403 14914 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2: Bootstrap starting.
12:13:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.941685 14911 tablet_bootstrap.cc:654] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2: Neither blocks nor log segments found. Creating new log.
12:13:15.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.945098 14914 tablet_bootstrap.cc:654] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2: Neither blocks nor log segments found. Creating new log.
12:13:15.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:15.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.962556 14914 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2: No bootstrap required, opened a new log
12:13:15.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.963020 14914 ts_tablet_manager.cc:1403] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.001s
12:13:15.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.966099 14914 raft_consensus.cc:359] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.966820 14914 raft_consensus.cc:385] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:15.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.967096 14914 raft_consensus.cc:740] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Initialized, Role: FOLLOWER
12:13:15.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.967993 14917 leader_election.cc:290] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:15.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.971058 14914 consensus_queue.cc:260] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.978150 14914 ts_tablet_manager.cc:1434] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
12:13:15.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.979188 14914 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2: Bootstrap starting.
12:13:15.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.981928 14923 raft_consensus.cc:493] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.982533 14923 raft_consensus.cc:515] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.987833 14923 leader_election.cc:290] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:15.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.988862 14912 consensus_queue.cc:260] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:15.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.995311 14912 ts_tablet_manager.cc:1434] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656: Time spent starting tablet: real 0.091s	user 0.003s	sys 0.004s
12:13:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:15.999284 14914 tablet_bootstrap.cc:654] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2: Neither blocks nor log segments found. Creating new log.
12:13:16.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.026398 14917 raft_consensus.cc:493] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.026852 14917 raft_consensus.cc:515] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.029400 14917 leader_election.cc:290] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.032374 14914 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2: No bootstrap required, opened a new log
12:13:16.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.032845 14914 ts_tablet_manager.cc:1403] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.006s
12:13:16.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.033214 14912 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656: Bootstrap starting.
12:13:16.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.039764 14914 raft_consensus.cc:359] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.040472 14914 raft_consensus.cc:385] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:16.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.041550 14917 raft_consensus.cc:493] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.042021 14917 raft_consensus.cc:515] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.040745 14914 raft_consensus.cc:740] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Initialized, Role: FOLLOWER
12:13:16.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.043942 14917 leader_election.cc:290] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.043969 14914 consensus_queue.cc:260] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.048611 14914 ts_tablet_manager.cc:1434] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
12:13:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.053328 14507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.053894 14506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba1d88f33479592499622388203ba" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.055138 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.055848 14505 raft_consensus.cc:2468] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.057125 14918 raft_consensus.cc:493] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.057698 14918 raft_consensus.cc:515] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.062023 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.062419 14365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba1d88f33479592499622388203ba" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.062641 14364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.062904 14366 raft_consensus.cc:2468] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.063129 14365 raft_consensus.cc:2468] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.063287 14364 raft_consensus.cc:2468] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.066304 14918 leader_election.cc:290] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:16.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.068287 14657 leader_election.cc:343] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355): Illegal state: must be running to vote when last-logged opid is not known
12:13:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.075579 14658 leader_election.cc:304] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, c03677bb70fe49339876d767c1854656; no voters: ca778b17fc924aba9d167da2ededa2a2
12:13:16.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.075776 14657 leader_election.cc:343] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355): Illegal state: must be running to vote when last-logged opid is not known
12:13:16.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.076747 14657 leader_election.cc:304] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c03677bb70fe49339876d767c1854656, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.077939 14917 raft_consensus.cc:2804] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.078303 14917 raft_consensus.cc:493] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.078604 14917 raft_consensus.cc:3060] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.087162 14917 raft_consensus.cc:515] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.090700 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.091301 14505 raft_consensus.cc:3060] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.096346 14561 tablet.cc:2406] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:16.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.099350 14505 raft_consensus.cc:2468] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 1.
12:13:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.100543 14657 leader_election.cc:304] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c03677bb70fe49339876d767c1854656, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.121668 14941 raft_consensus.cc:2804] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader election won for term 1
12:13:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.127223 14911 tablet_bootstrap.cc:492] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2: No bootstrap required, opened a new log
12:13:16.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.127663 14911 ts_tablet_manager.cc:1403] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2: Time spent bootstrapping tablet: real 0.198s	user 0.030s	sys 0.040s
12:13:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.131493 14911 raft_consensus.cc:359] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.132128 14911 raft_consensus.cc:385] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.132398 14911 raft_consensus.cc:740] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca778b17fc924aba9d167da2ededa2a2, State: Initialized, Role: FOLLOWER
12:13:16.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.133060 14911 consensus_queue.cc:260] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.135591 14911 ts_tablet_manager.cc:1434] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
12:13:16.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.141971 14911 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2: Bootstrap starting.
12:13:16.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.150511 14911 tablet_bootstrap.cc:654] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2: Neither blocks nor log segments found. Creating new log.
12:13:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.153136 14658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.164.193:45803, user_credentials={real_user=slave}} blocked reactor thread for 77813us
12:13:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.153899 14658 leader_election.cc:304] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, c03677bb70fe49339876d767c1854656; no voters: ca778b17fc924aba9d167da2ededa2a2
12:13:16.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.155158 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.155869 14505 raft_consensus.cc:2468] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06835ed424014fde8ab6c13d8ecf66a2 in term 0.
12:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.157303 14298 leader_election.cc:304] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.158282 14918 raft_consensus.cc:2804] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.158624 14918 raft_consensus.cc:493] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.158936 14918 raft_consensus.cc:3060] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.162197 14917 leader_election.cc:290] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Requested vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.163918 14917 raft_consensus.cc:2804] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.164250 14917 raft_consensus.cc:493] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.165006 14917 raft_consensus.cc:3060] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.165707 14918 raft_consensus.cc:515] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.168040 14918 leader_election.cc:290] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 election: Requested vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.170558 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.171229 14505 raft_consensus.cc:3060] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.120414 14940 raft_consensus.cc:2804] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.177479 14940 raft_consensus.cc:493] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.177875 14940 raft_consensus.cc:3060] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.182377 14912 tablet_bootstrap.cc:654] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656: Neither blocks nor log segments found. Creating new log.
12:13:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.186775 14505 raft_consensus.cc:2468] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06835ed424014fde8ab6c13d8ecf66a2 in term 1.
12:13:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.187260 14941 raft_consensus.cc:697] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [term 1 LEADER]: Becoming Leader. State: Replica: c03677bb70fe49339876d767c1854656, State: Running, Role: LEADER
12:13:16.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.189489 14941 consensus_queue.cc:237] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.203747 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "ca778b17fc924aba9d167da2ededa2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656" is_pre_election: true
12:13:16.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.207233 14364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "ca778b17fc924aba9d167da2ededa2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.207834 14364 raft_consensus.cc:2468] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca778b17fc924aba9d167da2ededa2a2 in term 0.
12:13:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.207979 14298 leader_election.cc:304] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.208149 14365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879efd1361794a50a103929e547b582d" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.208602 14918 raft_consensus.cc:2804] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election won for term 1
12:13:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.208652 14365 raft_consensus.cc:3060] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.209854 14441 leader_election.cc:304] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.210911 14923 raft_consensus.cc:2764] T 879efd1361794a50a103929e547b582d P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
12:13:16.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.216025 14912 tablet_bootstrap.cc:492] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656: No bootstrap required, opened a new log
12:13:16.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.216492 14912 ts_tablet_manager.cc:1403] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.001s
12:13:16.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.218035 14940 raft_consensus.cc:515] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:16.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.221942 14365 raft_consensus.cc:2468] T 879efd1361794a50a103929e547b582d P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 1.
12:13:16.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.221835 14917 raft_consensus.cc:515] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.224787 14364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba1d88f33479592499622388203ba" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.225555 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba1d88f33479592499622388203ba" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.226003 14364 raft_consensus.cc:3060] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.226099 14505 raft_consensus.cc:3060] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.230037 14940 leader_election.cc:290] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Requested vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.223820 14917 leader_election.cc:290] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Requested vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.231426 14506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.232754 14657 leader_election.cc:343] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355): Illegal state: must be running to vote when last-logged opid is not known
12:13:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.234359 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.234906 14366 raft_consensus.cc:3060] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.236747 14364 raft_consensus.cc:2468] T 4caba1d88f33479592499622388203ba P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 1.
12:13:16.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.241329 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656" is_pre_election: true
12:13:16.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.242690 14366 raft_consensus.cc:2468] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 1.
12:13:16.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.245509 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656"
12:13:16.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.247494 14299 leader_election.cc:343] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c03677bb70fe49339876d767c1854656 (127.13.164.195:38081): Illegal state: must be running to vote when last-logged opid is not known
12:13:16.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.244207 14658 leader_election.cc:304] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, c03677bb70fe49339876d767c1854656; no voters: 
12:13:16.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.249089 14658 leader_election.cc:304] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, c03677bb70fe49339876d767c1854656; no voters: ca778b17fc924aba9d167da2ededa2a2
12:13:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.248023 14173 catalog_manager.cc:5697] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 reported cstate change: term changed from 0 to 1, leader changed from <none> to c03677bb70fe49339876d767c1854656 (127.13.164.195). New cstate: current_term: 1 leader_uuid: "c03677bb70fe49339876d767c1854656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } health_report { overall_health: HEALTHY } } }
12:13:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.247737 14505 raft_consensus.cc:2468] T 4caba1d88f33479592499622388203ba P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 1.
12:13:16.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.251051 14918 raft_consensus.cc:697] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Running, Role: LEADER
12:13:16.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.252624 14918 consensus_queue.cc:237] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.254688 14941 raft_consensus.cc:2804] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader election won for term 1
12:13:16.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.223124 14912 raft_consensus.cc:359] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.256163 14912 raft_consensus.cc:385] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.256443 14912 raft_consensus.cc:740] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03677bb70fe49339876d767c1854656, State: Initialized, Role: FOLLOWER
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.256587 14942 raft_consensus.cc:2804] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader election won for term 1
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.257102 14942 raft_consensus.cc:697] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [term 1 LEADER]: Becoming Leader. State: Replica: c03677bb70fe49339876d767c1854656, State: Running, Role: LEADER
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:16.257715 14299 leader_election.cc:343] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c03677bb70fe49339876d767c1854656 (127.13.164.195:38081): Illegal state: must be running to vote when last-logged opid is not known
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.257872 14942 consensus_queue.cc:237] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:16.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.259373 14912 consensus_queue.cc:260] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.262786 14941 raft_consensus.cc:697] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [term 1 LEADER]: Becoming Leader. State: Replica: c03677bb70fe49339876d767c1854656, State: Running, Role: LEADER
12:13:16.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.264117 14941 consensus_queue.cc:237] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.265007 14911 tablet_bootstrap.cc:492] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2: No bootstrap required, opened a new log
12:13:16.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.265496 14911 ts_tablet_manager.cc:1403] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.005s
12:13:16.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.290452 14940 raft_consensus.cc:493] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.291244 14940 raft_consensus.cc:515] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.293835 14940 leader_election.cc:290] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.291635 14912 ts_tablet_manager.cc:1434] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
12:13:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.294555 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.295240 14912 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656: Bootstrap starting.
12:13:16.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.295225 14505 raft_consensus.cc:2468] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.296602 14657 leader_election.cc:304] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c03677bb70fe49339876d767c1854656, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.297451 14940 raft_consensus.cc:2804] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.297761 14940 raft_consensus.cc:493] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.298029 14940 raft_consensus.cc:3060] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.300586 14946 raft_consensus.cc:493] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.300817 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.268236 14911 raft_consensus.cc:359] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:16.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.301120 14946 raft_consensus.cc:515] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.302745 14366 raft_consensus.cc:2468] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c03677bb70fe49339876d767c1854656 in term 0.
12:13:16.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.303982 14946 leader_election.cc:290] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:16.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.302201 14911 raft_consensus.cc:385] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:16.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.305409 14911 raft_consensus.cc:740] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca778b17fc924aba9d167da2ededa2a2, State: Initialized, Role: FOLLOWER
12:13:16.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.305598 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656" is_pre_election: true
12:13:16.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.310235 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.310801 14505 raft_consensus.cc:2468] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06835ed424014fde8ab6c13d8ecf66a2 in term 0.
12:13:16.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.310763 14940 raft_consensus.cc:515] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.311939 14724 raft_consensus.cc:2393] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06835ed424014fde8ab6c13d8ecf66a2 in current term 1: Already voted for candidate c03677bb70fe49339876d767c1854656 in this term.
12:13:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.313127 14298 leader_election.cc:304] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2; no voters: 
12:13:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.313956 14946 raft_consensus.cc:2804] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.314254 14946 raft_consensus.cc:493] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:16.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.314559 14946 raft_consensus.cc:3060] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.316591 14912 tablet_bootstrap.cc:654] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656: Neither blocks nor log segments found. Creating new log.
12:13:16.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.310832 14911 consensus_queue.cc:260] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:16.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.327140 14946 raft_consensus.cc:515] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.330096 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656"
12:13:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.330890 14724 raft_consensus.cc:2393] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06835ed424014fde8ab6c13d8ecf66a2 in current term 1: Already voted for candidate c03677bb70fe49339876d767c1854656 in this term.
12:13:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.328730 14940 leader_election.cc:290] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Requested vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.333597 14506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "06835ed424014fde8ab6c13d8ecf66a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.334211 14506 raft_consensus.cc:3060] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.330235 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2"
12:13:16.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.342067 14366 raft_consensus.cc:2393] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c03677bb70fe49339876d767c1854656 in current term 1: Already voted for candidate 06835ed424014fde8ab6c13d8ecf66a2 in this term.
12:13:16.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.328977 14946 leader_election.cc:290] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 election: Requested vote from peers ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355), c03677bb70fe49339876d767c1854656 (127.13.164.195:38081)
12:13:16.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.347069 14172 catalog_manager.cc:5697] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193). New cstate: current_term: 1 leader_uuid: "06835ed424014fde8ab6c13d8ecf66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } health_report { overall_health: UNKNOWN } } }
12:13:16.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.349655 14505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e38f3e15185749fbbed7d50575e0af6a" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2"
12:13:16.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.351063 14657 leader_election.cc:304] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c03677bb70fe49339876d767c1854656; no voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2
12:13:16.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.355011 14506 raft_consensus.cc:2468] T e38f3e15185749fbbed7d50575e0af6a P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06835ed424014fde8ab6c13d8ecf66a2 in term 1.
12:13:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.356900 14298 leader_election.cc:304] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2; no voters: c03677bb70fe49339876d767c1854656
12:13:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.357694 14946 raft_consensus.cc:2804] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader election won for term 1
12:13:16.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.358110 14946 raft_consensus.cc:697] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 LEADER]: Becoming Leader. State: Replica: 06835ed424014fde8ab6c13d8ecf66a2, State: Running, Role: LEADER
12:13:16.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.358852 14946 consensus_queue.cc:237] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.361466 14940 raft_consensus.cc:2749] T e38f3e15185749fbbed7d50575e0af6a P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
12:13:16.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.366168 14911 ts_tablet_manager.cc:1434] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.000s
12:13:16.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.375932 14173 catalog_manager.cc:5697] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 reported cstate change: term changed from 0 to 1, leader changed from <none> to c03677bb70fe49339876d767c1854656 (127.13.164.195). New cstate: current_term: 1 leader_uuid: "c03677bb70fe49339876d767c1854656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } health_report { overall_health: HEALTHY } } }
12:13:16.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.379243 14173 catalog_manager.cc:5697] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 reported cstate change: term changed from 0 to 1, leader changed from <none> to c03677bb70fe49339876d767c1854656 (127.13.164.195). New cstate: current_term: 1 leader_uuid: "c03677bb70fe49339876d767c1854656" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } health_report { overall_health: UNKNOWN } } }
12:13:16.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.422128 14172 catalog_manager.cc:5697] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193). New cstate: current_term: 1 leader_uuid: "06835ed424014fde8ab6c13d8ecf66a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } health_report { overall_health: UNKNOWN } } }
12:13:16.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.449538 14912 tablet_bootstrap.cc:492] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656: No bootstrap required, opened a new log
12:13:16.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.450001 14912 ts_tablet_manager.cc:1403] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656: Time spent bootstrapping tablet: real 0.155s	user 0.010s	sys 0.008s
12:13:16.452 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.452494 14912 raft_consensus.cc:359] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.454030 14912 raft_consensus.cc:385] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.454288 14912 raft_consensus.cc:740] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c03677bb70fe49339876d767c1854656, State: Initialized, Role: FOLLOWER
12:13:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.455047 14912 consensus_queue.cc:260] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.470984 14912 ts_tablet_manager.cc:1434] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
12:13:16.522 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state READY
12:13:16.522 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state READY
12:13:16.522 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state READY
12:13:16.523 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.238.252:39469(127.12.238.252:39469)] handling channelInactive
12:13:16.523 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state READY due to: connection closed
12:13:16.524 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.238.253:35475(127.12.238.253:35475)] handling channelInactive
12:13:16.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state READY due to: connection closed
12:13:16.528 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:16.529 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:13:16.531 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:13:16.553 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.238.254:35497(127.12.238.254:35497)] handling channelInactive
12:13:16.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state READY due to: connection closed
12:13:16.554 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:13:16.554 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state READY
12:13:16.555 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state READY
12:13:16.555 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state READY
12:13:16.555 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:16.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:16.556 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:16.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:16.556 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:16.560 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
12:13:16.561 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:13:16.570 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:16.570 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:16.570 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:13:16.573 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:16.573 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:13:16.573 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:13:16.573 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:16.573 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:16.574 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:13:16.593 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:13:16.593 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:13:16.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.616331 14923 raft_consensus.cc:493] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.616870 14923 raft_consensus.cc:515] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } } peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } }
12:13:16.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.618882 14923 leader_election.cc:290] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c03677bb70fe49339876d767c1854656 (127.13.164.195:38081), 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803)
12:13:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.620064 14724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "ca778b17fc924aba9d167da2ededa2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c03677bb70fe49339876d767c1854656" is_pre_election: true
12:13:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.620265 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8c303050444b978d2ca60d12cf6663" candidate_uuid: "ca778b17fc924aba9d167da2ededa2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.620951 14366 raft_consensus.cc:2393] T 1b8c303050444b978d2ca60d12cf6663 P 06835ed424014fde8ab6c13d8ecf66a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca778b17fc924aba9d167da2ededa2a2 in current term 1: Already voted for candidate c03677bb70fe49339876d767c1854656 in this term.
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.622179 14941 raft_consensus.cc:493] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.622610 14941 raft_consensus.cc:515] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 } } peers { permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 } } peers { permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 } }
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.624493 14941 leader_election.cc:290] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803), ca778b17fc924aba9d167da2ededa2a2 (127.13.164.194:45355)
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.626405 14441 leader_election.cc:304] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca778b17fc924aba9d167da2ededa2a2; no voters: 06835ed424014fde8ab6c13d8ecf66a2, c03677bb70fe49339876d767c1854656
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.627059 14506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca778b17fc924aba9d167da2ededa2a2" is_pre_election: true
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.627794 14506 raft_consensus.cc:2393] T db06082c4313457fbbf84101e22144c2 P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c03677bb70fe49339876d767c1854656 in current term 1: Already voted for candidate 06835ed424014fde8ab6c13d8ecf66a2 in this term.
12:13:16.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.628192 14923 raft_consensus.cc:3060] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.629796 14366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db06082c4313457fbbf84101e22144c2" candidate_uuid: "c03677bb70fe49339876d767c1854656" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06835ed424014fde8ab6c13d8ecf66a2" is_pre_election: true
12:13:16.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.633966 14658 leader_election.cc:304] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c03677bb70fe49339876d767c1854656; no voters: 06835ed424014fde8ab6c13d8ecf66a2, ca778b17fc924aba9d167da2ededa2a2
12:13:16.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.635257 14941 raft_consensus.cc:3060] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 0 FOLLOWER]: Advancing to term 1
12:13:16.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.635919 14923 raft_consensus.cc:2749] T 1b8c303050444b978d2ca60d12cf6663 P ca778b17fc924aba9d167da2ededa2a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:16.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.642416 14941 raft_consensus.cc:2749] T db06082c4313457fbbf84101e22144c2 P c03677bb70fe49339876d767c1854656 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:16.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.657752 14941 consensus_queue.cc:1048] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.689435 14942 consensus_queue.cc:1048] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.704149 14941 consensus_queue.cc:1048] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.731827 14918 consensus_queue.cc:1048] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.740753 14946 consensus_queue.cc:1048] T db06082c4313457fbbf84101e22144c2 P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.741892 14942 consensus_queue.cc:1048] T 1b8c303050444b978d2ca60d12cf6663 P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.777454 14942 consensus_queue.cc:1048] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.829452 14917 consensus_queue.cc:1048] T 4caba1d88f33479592499622388203ba P c03677bb70fe49339876d767c1854656 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06835ed424014fde8ab6c13d8ecf66a2" member_type: VOTER last_known_addr { host: "127.13.164.193" port: 45803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.856775 14946 consensus_queue.cc:1048] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca778b17fc924aba9d167da2ededa2a2" member_type: VOTER last_known_addr { host: "127.13.164.194" port: 45355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.860 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:13:16.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:16.887581 14946 consensus_queue.cc:1048] T e38f3e15185749fbbed7d50575e0af6a P 06835ed424014fde8ab6c13d8ecf66a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c03677bb70fe49339876d767c1854656" member_type: VOTER last_known_addr { host: "127.13.164.195" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:16.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:16.994 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:13:16.994 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:13:16.994 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:13:17.009 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:13:17.409 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:17.409 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:17.410 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:17.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:17.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:17.410 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:17.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:17.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:17.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:17.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:17.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:17.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:17.411 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:17.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:17.931 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:13:17.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:18.091 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:13:18.116 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:13:18.180 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:13:18.202 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:13:18.215 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:18.215 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:18.216 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:18.216 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.216 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.217 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.218 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.218 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.218 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.218 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:18.224 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:13:18.250 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:18.250 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:18.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.251 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.251 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:18.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.252 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.252 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.252 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.252 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.252 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.252 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.252 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:18.253 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:13:18.256 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:13:18.256 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:13:18.256 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:13:18.257 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:13:18.257 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:13:18.257 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:13:18.257 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:13:18.258 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:13:18.258 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:13:18.258 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:13:18.259 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:13:18.259 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:13:18.259 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:13:18.259 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:13:18.259 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:13:18.259 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:13:18.259 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:13:18.259 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:13:18.259 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:13:18.260 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:13:18.261 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:13:18.261 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:13:18.261 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:13:18.264 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_fe415ec1fd9f4a7e421058a0e21b501d/blobStorage
12:13:18.265 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:40995 - max concurrent requests: 50 - max backlog: 1000
12:13:18.266 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_fe415ec1fd9f4a7e421058a0e21b501d/blobStorage
12:13:18.267 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_fe415ec1fd9f4a7e421058a0e21b501d/blobStorage
12:13:18.267 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:13:18.268 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: e8ac90f3-d004-4934-a36d-11d5c4497d29
12:13:18.270 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:13:18.270 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-60c2557c-d99f-4ddb-a2ff-df8ed200970d
12:13:18.273 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-81da3e49-e4a2-4a62-9eae-bde6a7b6ba56
12:13:18.352 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:13:18.352 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:13:18.352 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:13:18.352 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:13:18.353 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:13:18.355 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_4 .
12:13:18.381 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:18.382 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:18.382 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:18.382 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:18.382 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:18.382 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:18.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:18.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:18.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:18.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:18.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:18.383 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:18.383 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:18.386 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
12:13:18.386 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-26b930ec-c817-48d1-b2d0-608b2639e1ef
12:13:18.391 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:13:18.392 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:13:18.415 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:13:18.415 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:13:18.421 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:40853
12:13:18.421 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:13:18.423 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:13:18.423 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:40853 was granted leadership with leaderSessionID=05dabd7d-727f-4771-9b7c-f0fdc0dd04f8
12:13:18.423 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:40853 , session=05dabd7d-727f-4771-9b7c-f0fdc0dd04f8
12:13:18.423 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:13:18.423 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:13:18.424 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id dccd8830-8529-4f0d-b3a3-80b8da6658f5. Creating new DispatcherLeaderProcess.
12:13:18.424 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:13:18.424 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:13:18.433 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:13:18.433 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:13:18.436 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_5 .
12:13:18.443 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_5 , session=dccd8830-8529-4f0d-b3a3-80b8da6658f5
12:13:18.444 [INFO - pool-49-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id b45f99bc-3d23-4879-8cf5-abb2ab33f906.
12:13:18.446 [INFO - pool-49-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_6 .
12:13:18.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:18.464 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
12:13:18.494 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:18.495 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:18.495 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:18.495 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.495 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.495 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.496 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.496 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.496 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.496 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:18.499 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:13:18.499 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:13:18.499 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:13:18.499 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:13:18.512 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_6 , session=b45f99bc-3d23-4879-8cf5-abb2ab33f906
12:13:18.513 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(8cf5abb2ab33f906b45f99bc3d234879).
12:13:18.532 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:13:18.553 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1080) Registering TaskManager with ResourceID e8ac90f3-d004-4934-a36d-11d5c4497d29 (pekko://flink/user/rpc/taskmanager_4) at ResourceManager
12:13:18.557 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_6 under registration id 1da407302bf9fb490e7266fc0d24d9d3.
12:13:18.558 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.558 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.558 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor e8ac90f3-d004-4934-a36d-11d5c4497d29 under 1da407302bf9fb490e7266fc0d24d9d3 at the slot manager.
12:13:18.558 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-8680f415d5d255088cd51ec1e8014bb4'.
12:13:18.559 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 8680f415d5d255088cd51ec1e8014bb4 was granted leadership with leader id 72252e87-1402-4fee-8c1f-16ad2bf8fdde. Creating new JobMasterServiceProcess.
12:13:18.573 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_7 .
12:13:18.580 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.581 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.581 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 267c32c239125ae072b47a4c03776bf2 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.582 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.582 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:13:18.583 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:13:18.583 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ea070a7
12:13:18.583 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:18.583 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:18.588 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:13:18.588 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@31142d7c for Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4).
12:13:18.589 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_7 , session=72252e87-1402-4fee-8c1f-16ad2bf8fdde
12:13:18.593 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (8680f415d5d255088cd51ec1e8014bb4) under job master id 8c1f16ad2bf8fdde72252e8714024fee.
12:13:18.593 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:13:18.595 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:18.600 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:13:18.601 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state CREATED to RUNNING.
12:13:18.602 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:13:18.603 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:13:18.603 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:13:18.604 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:13:18.604 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_6(8cf5abb2ab33f906b45f99bc3d234879)
12:13:18.609 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:13:18.609 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:390) Registering job manager 8c1f16ad2bf8fdde72252e8714024fee@pekko://flink/user/rpc/jobmanager_7 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.611 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:18.611 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:18.611 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:18.611 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.612 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:18.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.612 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:18.613 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.613 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:18.613 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:18.619 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1015) Registered job manager 8c1f16ad2bf8fdde72252e8714024fee@pekko://flink/user/rpc/jobmanager_7 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.622 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 8cf5abb2ab33f906b45f99bc3d234879.
12:13:18.623 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:13:18.625 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 8680f415d5d255088cd51ec1e8014bb4
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager e8ac90f3-d004-4934-a36d-11d5c4497d29
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:13:18.626 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot de5ed38ba08a07738380230c918cff9a from e8ac90f3-d004-4934-a36d-11d5c4497d29 for job 8680f415d5d255088cd51ec1e8014bb4 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.627 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot cea21aacffbe33a581aa8d6918420aeb from e8ac90f3-d004-4934-a36d-11d5c4497d29 for job 8680f415d5d255088cd51ec1e8014bb4 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.627 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 7fc68cc9e14a520e7d6ce73a3865b2fb from e8ac90f3-d004-4934-a36d-11d5c4497d29 for job 8680f415d5d255088cd51ec1e8014bb4 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.629 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request de5ed38ba08a07738380230c918cff9a for job 8680f415d5d255088cd51ec1e8014bb4 from resource manager with leader id 8cf5abb2ab33f906b45f99bc3d234879.
12:13:18.629 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for de5ed38ba08a07738380230c918cff9a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.630 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:18.631 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 961f0346c9a412a84fbfc0b9a06661b0 from e8ac90f3-d004-4934-a36d-11d5c4497d29 for job 8680f415d5d255088cd51ec1e8014bb4 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.638 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:18.640 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:192) Add job 8680f415d5d255088cd51ec1e8014bb4 for job leader monitoring.
12:13:18.641 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request cea21aacffbe33a581aa8d6918420aeb for job 8680f415d5d255088cd51ec1e8014bb4 from resource manager with leader id 8cf5abb2ab33f906b45f99bc3d234879.
12:13:18.641 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for cea21aacffbe33a581aa8d6918420aeb with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.641 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 7fc68cc9e14a520e7d6ce73a3865b2fb for job 8680f415d5d255088cd51ec1e8014bb4 from resource manager with leader id 8cf5abb2ab33f906b45f99bc3d234879.
12:13:18.642 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 7fc68cc9e14a520e7d6ce73a3865b2fb with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.642 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1149) Receive slot request 961f0346c9a412a84fbfc0b9a06661b0 for job 8680f415d5d255088cd51ec1e8014bb4 from resource manager with leader id 8cf5abb2ab33f906b45f99bc3d234879.
12:13:18.642 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:321) Allocated slot for 961f0346c9a412a84fbfc0b9a06661b0 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:18.643 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_7 with leader id 72252e87-1402-4fee-8c1f-16ad2bf8fdde.
12:13:18.644 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:13:18.646 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_7 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.646 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1783) Establish JobManager connection for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.646 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.647 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:13:18.647 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:13:18.652 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:13:18.655 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:18.655 [INFO - flink-pekko.actor.default-dispatcher-6] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:13:18.655 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 8680f415d5d255088cd51ec1e8014bb4
12:13:18.657 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:13:18.662 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:18.664 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:18.682 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:18.685 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:18.693 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.238.254:35497(127.12.238.254:35497)] Successfully connected to peer
12:13:18.698 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:18.708 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.238.252:39469(127.12.238.252:39469)] Successfully connected to peer
12:13:18.708 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.254
12:13:18.710 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.238.253:35475(127.12.238.253:35475)] Successfully connected to peer
12:13:18.722 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.726 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf191a101, L:/127.0.0.1:41798 - R:/127.12.238.254:35497] using SASL/PLAIN
12:13:18.733 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.252
12:13:18.743 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.747 [DEBUG - main] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:18.750 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:18.753 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x009436c1, L:/127.0.0.1:37584 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:18.762 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.253
12:13:18.766 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.771 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:18.782 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:18.784 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469] using SASL/PLAIN
12:13:18.786 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.796 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:13:18.796 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:13:18.797 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.798 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:18.798 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=175), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [113ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: OK, deferred=null) after lookup
12:13:18.800 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x642fe4d1, L:/127.0.0.1:51774 - R:/127.12.238.253:35475] using SASL/PLAIN
12:13:18.806 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:13:18.806 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:13:18.806 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:13:18.806 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:13:18.807 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:13:18.808 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:13:18.809 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:13:18.816 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:13:18.817 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:13:18.822 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:13:18.822 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:13:18.822 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:13:18.829 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:13:18.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:13:18.830 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:13:18.830 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@73816137
12:13:18.831 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:13:18.832 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b4f7783
12:13:18.832 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:18.833 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:18.833 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:13:18.833 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:13:18.838 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe4b71877, L:/127.0.0.1:57474 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:18.840 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f524b7b
12:13:18.843 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:18.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:18.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:18.844 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:13:18.844 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:13:18.848 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a1d3e19
12:13:18.849 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:18.849 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:18.849 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:18.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:13:18.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:13:18.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:13:18.854 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:13:18.855 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:18.855 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:13:18.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:13:18.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5dd87537
12:13:18.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:18.856 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:18.857 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:13:18.857 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:13:18.858 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:13:18.858 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:13:18.866 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:18.866 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:18.866 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:18.866 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:18.866 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:18.867 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:18.868 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:18.868 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=246), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [128ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [238ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:18.872 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:18.878 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1b8c303050444b978d2ca60d12cf6663 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:18.878 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:18.878 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:18.878 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:18.878 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:18.878 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1b8c303050444b978d2ca60d12cf6663@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:18.879 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.13.164.252:40513, [4ms] Sub RPC GetTableLocations: received response from server master-127.13.164.252:40513: OK, deferred=null)) after lookup
12:13:18.879 [DEBUG - kudu-nio-1] (Connection.java:748) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] connecting to peer
12:13:18.881 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.883 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c5fcfb1
12:13:18.886 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] Successfully connected to peer
12:13:18.888 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:18.891 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d8d96fb
12:13:18.901 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@47f9784b
12:13:18.902 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:18.902 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9ffc767f, L:/127.0.0.1:60232 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:18.903 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:18.906 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:18.907 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:18.915 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:18.918 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:18.919 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:18.925 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:18.925 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.926 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:18.929 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:18.929 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xb98a6df5, L:/127.0.0.1:33746 - R:/127.13.164.195:38081] using TOKEN/null
12:13:18.929 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:18.936 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:18.938 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.939 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:18.938 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:18.943 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:18.944 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.944 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:18.945 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:18.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:18.957 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd6105944, L:/127.0.0.1:37588 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:18.960 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:18.965 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:18.972 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.978 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:18.987 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:18.989 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:18.989 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:18.990 [DEBUG - main] (Connection.java:748) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] connecting to peer
12:13:18.992 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd2d5c30b, L:/127.0.0.1:57482 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:18.994 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:18.996 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:18.996 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=153), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [94ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:18.998 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:18.999 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:19.000 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:19.003 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:19.004 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.005 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:19.007 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:19.007 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:19.008 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.008 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:18.992 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4a4809e6, L:/127.0.0.1:37598 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:19.011 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x22b9a32c, L:/127.0.0.1:60242 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:19.012 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:19.013 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] Successfully connected to peer
12:13:19.013 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe49b06c8, L:/127.0.0.1:57490 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:19.014 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:19.018 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:19.018 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=130), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [111ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [114ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:19.020 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:19.022 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.025 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.025 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@14c57e8
12:13:19.027 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:13:19.027 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:13:19.028 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:19.034 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.13.164.254:45345(127.13.164.254:45345)] Successfully connected to peer
12:13:19.036 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.037 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@184bf030
12:13:19.038 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:13:19.038 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:13:19.043 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.044 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.254
12:13:19.045 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.046 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.050 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x6559200a, L:/127.0.0.1:50936 - R:/127.13.164.193:45803] using TOKEN/null
12:13:19.052 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.055 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.064 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.13.164.252:40513(127.13.164.252:40513)] Successfully connected to peer
12:13:19.067 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x79170d20, L:/127.0.0.1:48152 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:19.069 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.252
12:13:19.071 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x61315a3c, L:/127.0.0.1:60254 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:19.072 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa0d5a9b2, L:/127.0.0.1:38226 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:19.077 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x76ea1848, L:/127.0.0.1:44386 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:19.080 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:19.080 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=153), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [94ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:19.083 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.088 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.092 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@44b89b0d
12:13:19.094 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:13:19.094 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:13:19.094 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x35e333e0, L:/127.0.0.1:48160 - R:/127.13.164.254:45345] using SASL/PLAIN
12:13:19.100 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.100 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.103 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.13.164.253:36317(127.13.164.253:36317)] Successfully connected to peer
12:13:19.106 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.13.164.253
12:13:19.106 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.106 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.111 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.118 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.118 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.121 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:13:19.122 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9bea244ab86de0a3b08939ffee28629bb6a869f8d12208e7b06bdfd9bcc9577a'}]
12:13:19.124 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:19.125 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.127 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x6e309b6a, L:/127.0.0.1:44392 - R:/127.13.164.252:40513] using SASL/PLAIN
12:13:19.132 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.134 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:19.134 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=188), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [110ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: OK, [139ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: OK, deferred=null) after lookup
12:13:19.137 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.140 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:19.141 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c75d9a
12:13:19.142 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:13:19.143 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='45c16644a750d83e2118a47d700419d54c1f5b67e51f488e7f995c33086314f8'}]
12:13:19.145 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:19.146 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x1bec741d, L:/127.0.0.1:38238 - R:/127.13.164.253:36317] using SASL/PLAIN
12:13:19.151 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:13:19.152 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299996, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:19.159 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:13:19.159 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7198238feb784bfb1e9d5f0c7d8328f921a5b9bd5505c4bbc6d55c5a01bea793'}]
12:13:19.161 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:19.171 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:13:19.173 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299996, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:19.183 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.183 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.189 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.189 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.195 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.196 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.198 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:13:19.199 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299996, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:19.202 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.202 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.209 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.216 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:19.265 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.265 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.272 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.272 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.278 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.284 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.285 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.290 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.319 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:13:19.331 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:19.348 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.348 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.355 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.355 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.362 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.363 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.371 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:19.376 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.376 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.383 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.387 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:19.389 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:13:19.390 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:13:19.390 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:13:19.390 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:13:19.391 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:13:19.391 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:13:19.393 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:19.398 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='21eba996f1e85a278dfa8c73ca5c0850fe9cc821e947bf5d764b67191c3ae616'}]
12:13:19.400 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:19.403 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:19.404 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:13:19.407 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299996, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:19.409 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:19.410 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:19.421 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:19.430 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512799428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:19.443 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:19.449 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.450 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.456 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1ad54078, L:/127.0.0.1:39566 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:19.463 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:19.464 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.464 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.481 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.485 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcb1366c5, L:/127.0.0.1:39592 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:19.488 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:19.493 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.494 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.497 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.499 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.499 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.501 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4d06b31, L:/127.0.0.1:39608 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:19.509 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.531 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:19.532 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 8680f415d5d255088cd51ec1e8014bb4 (4464 bytes, checkpointDuration=103 ms, finalizationTime=1 ms).
12:13:19.534 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:13:19.549 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305268423155712001) for scanner KuduScanner(table=replication_test_table, tablet=ebd236911db54f4bac13b7b9cbb4f652, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.549 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9bea244ab86de0a3b08939ffee28629bb6a869f8d12208e7b06bdfd9bcc9577a]
12:13:19.550 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:13:19.558 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9bea244ab86de0a3b08939ffee28629bb6a869f8d12208e7b06bdfd9bcc9577a]
12:13:19.561 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9bea244ab86de0a3b08939ffee28629bb6a869f8d12208e7b06bdfd9bcc9577a finished by subtask 0; deferring removal (restored in pending)
12:13:19.564 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:13:19.564 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:13:19.564 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:19.564 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d3788a579755a3345daeab8f5c5997fc113a089ea28b9e7d9f439cb8120e5b37'}]
12:13:19.565 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:19.570 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.570 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.571 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:19.571 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:19.572 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:13:19.572 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:13:19.577 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.578 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.578 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1b8c303050444b978d2ca60d12cf6663 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:19.579 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:19.579 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.579 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.579 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.579 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1b8c303050444b978d2ca60d12cf6663@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.580 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1b8c303050444b978d2ca60d12cf6663 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:19.580 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:19.580 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.580 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.580 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.583 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299997, tablet=1b8c303050444b978d2ca60d12cf6663@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299997}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299997}]
12:13:19.586 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.587 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.587 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.593 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.593 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.597 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:19.598 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.601 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x09eb3930, L:/127.0.0.1:39582 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:19.601 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:13:19.602 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299996, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:19.619 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305268423155712001) for scanner KuduScanner(table=replication_test_table, tablet=590b08f86d964759845bbd0e012bf367, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.620 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [21eba996f1e85a278dfa8c73ca5c0850fe9cc821e947bf5d764b67191c3ae616]
12:13:19.620 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:13:19.623 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [21eba996f1e85a278dfa8c73ca5c0850fe9cc821e947bf5d764b67191c3ae616]
12:13:19.624 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 21eba996f1e85a278dfa8c73ca5c0850fe9cc821e947bf5d764b67191c3ae616 finished by subtask 3; deferring removal (restored in pending)
12:13:19.624 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:13:19.625 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:13:19.625 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:19.626 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:19.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.633 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.634 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.634 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.634 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.635 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.635 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.635 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.647 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305268423155712001) for scanner KuduScanner(table=replication_test_table, tablet=e909236b061042d583fcc54c35a1ed89, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.649 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [45c16644a750d83e2118a47d700419d54c1f5b67e51f488e7f995c33086314f8]
12:13:19.649 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:13:19.650 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.650 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.650 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.652 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [45c16644a750d83e2118a47d700419d54c1f5b67e51f488e7f995c33086314f8]
12:13:19.655 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 45c16644a750d83e2118a47d700419d54c1f5b67e51f488e7f995c33086314f8 finished by subtask 1; deferring removal (restored in pending)
12:13:19.656 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:13:19.656 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:13:19.656 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:19.656 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:19.659 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.660 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.660 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.660 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.660 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.661 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.661 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.662 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.662 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.662 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.663 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.663 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.663 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.663 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.677 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305268423155712001) for scanner KuduScanner(table=replication_test_table, tablet=f074eebe7fc641aa82cd0f5a960efb46, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.677 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [7198238feb784bfb1e9d5f0c7d8328f921a5b9bd5505c4bbc6d55c5a01bea793]
12:13:19.678 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:13:19.680 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7198238feb784bfb1e9d5f0c7d8328f921a5b9bd5505c4bbc6d55c5a01bea793]
12:13:19.680 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:13:19.681 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:13:19.681 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:19.681 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7198238feb784bfb1e9d5f0c7d8328f921a5b9bd5505c4bbc6d55c5a01bea793 finished by subtask 2; deferring removal (restored in pending)
12:13:19.684 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:19.685 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:19.685 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:19.685 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:19.685 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:19.686 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:19.695 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:19.697 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.697 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.702 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:19.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:19.702 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:13:19.703 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:13:19.703 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.703 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.709 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.709 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.714 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:19.714 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:19.715 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:19.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:19.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:19.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:19.715 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:19.715 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:19.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:19.716 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:19.716 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:19.716 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:19.716 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:19.718 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.734 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:19.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:19.734 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:13:19.734 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:13:19.748 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:13:19.748 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:19.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:19.749 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:19.757 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:19.765 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:19.775 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.775 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.782 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.783 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.788 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.788 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.794 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.794 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.800 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.817 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:19.820 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x75299a1f, L:/127.0.0.1:39616 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:19.841 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268423155712001) for scanner KuduScanner(table=replication_test_table, tablet=bd0762c6ba7e4d2e88b05e270a68ca72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.842 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [d3788a579755a3345daeab8f5c5997fc113a089ea28b9e7d9f439cb8120e5b37]
12:13:19.842 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d3788a579755a3345daeab8f5c5997fc113a089ea28b9e7d9f439cb8120e5b37]
12:13:19.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:13:19.843 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:13:19.843 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:19.844 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:19.844 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d3788a579755a3345daeab8f5c5997fc113a089ea28b9e7d9f439cb8120e5b37 finished by subtask 0; deferring removal (restored in pending)
12:13:19.857 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.857 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.863 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.864 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.870 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.870 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.878 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:19.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:19.878 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.879 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.879 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:19.879 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:13:19.891 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.931 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512799928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:19.936 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=130, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@43e99ffb, flushNotification=Deferred@1904909440(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:13:19.936 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=195, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@26c9ade8, flushNotification=Deferred@493863150(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:13:19.936 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=65, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@76f1b05, flushNotification=Deferred@1922410806(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:13:19.937 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] connecting to peer
12:13:19.938 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=260, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@23785b7c, flushNotification=Deferred@1680102583(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:13:19.943 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] connecting to peer
12:13:19.944 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] connecting to peer
12:13:19.944 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] connecting to peer
12:13:19.947 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] Successfully connected to peer
12:13:19.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:19.948 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.948 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:19.950 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] Successfully connected to peer
12:13:19.955 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.955 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:19.956 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] Successfully connected to peer
12:13:19.966 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] Successfully connected to peer
12:13:19.969 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.969 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:19.989 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.989 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:19.995 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:19.997 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.007 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.011 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf7f0b324, L:/127.0.0.1:50950 - R:/127.13.164.193:45803] using TOKEN/null
12:13:20.025 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x483f83ba, L:/127.0.0.1:50958 - R:/127.13.164.193:45803] using TOKEN/null
12:13:20.040 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.053 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.053 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.059 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x05e87b21, L:/127.0.0.1:36156 - R:/127.13.164.195:38081] using TOKEN/null
12:13:20.064 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.065 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.098 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.099 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.106 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.106 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.111 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.113 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.161 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x248536cc, L:/127.0.0.1:36162 - R:/127.13.164.195:38081] using TOKEN/null
12:13:20.171 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.172 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.179 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.179 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.185 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.186 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.194 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.195 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.201 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.250 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:20.251 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:20.251 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:20.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.254 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:20.267 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.267 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.276 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.276 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.283 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.283 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.289 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.289 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.305 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:20.313071 13956 debug-util.cc:398] Leaking SignalData structure 0x7b0800038160 after lost signal to thread 13829
12:13:20.371 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.372 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.375 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:20.375 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:20.376 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:20.376 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 8680f415d5d255088cd51ec1e8014bb4 (4464 bytes, checkpointDuration=447 ms, finalizationTime=1 ms).
12:13:20.377 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.377 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.377 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.377 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.377 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.377 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.378 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.378 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.378 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.378 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:20.380 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:13:20.380 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split d3788a579755a3345daeab8f5c5997fc113a089ea28b9e7d9f439cb8120e5b37 from pending
12:13:20.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 9bea244ab86de0a3b08939ffee28629bb6a869f8d12208e7b06bdfd9bcc9577a from pending
12:13:20.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 45c16644a750d83e2118a47d700419d54c1f5b67e51f488e7f995c33086314f8 from pending
12:13:20.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 7198238feb784bfb1e9d5f0c7d8328f921a5b9bd5505c4bbc6d55c5a01bea793 from pending
12:13:20.380 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 21eba996f1e85a278dfa8c73ca5c0850fe9cc821e947bf5d764b67191c3ae616 from pending
12:13:20.380 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 5 finished splits from enumerator state
12:13:20.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.414 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.414 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.425 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.432 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512800428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:20.433 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:20.453 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:20.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:20.457 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=29 ms, finalizationTime=0 ms).
12:13:20.457 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:20.460 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:13:20.463 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:20.468 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:20.468 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:20.468 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:20.468 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:20.468 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:20.468 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:20.490 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1b8c303050444b978d2ca60d12cf6663 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:20.491 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:20.491 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:20.491 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:20.491 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:20.491 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1b8c303050444b978d2ca60d12cf6663@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:20.496 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:20.499 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 7ee4dd18a5f04268a3cc94494e82d299
12:13:20.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:20.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:20.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:20.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:20.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:20.505 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:20.505 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.238.252:39469, [4ms] Sub RPC GetTableLocations: received response from server master-127.12.238.252:39469: OK, deferred=null)) after lookup
12:13:20.514 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ebd236911db54f4bac13b7b9cbb4f652, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.515 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ebd236911db54f4bac13b7b9cbb4f652 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.524 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f074eebe7fc641aa82cd0f5a960efb46, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.524 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f074eebe7fc641aa82cd0f5a960efb46 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.555 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e909236b061042d583fcc54c35a1ed89, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.555 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet e909236b061042d583fcc54c35a1ed89 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.589 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=590b08f86d964759845bbd0e012bf367, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.589 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 590b08f86d964759845bbd0e012bf367 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.596 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd0762c6ba7e4d2e88b05e270a68ca72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1b8c303050444b978d2ca60d12cf6663 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:20.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e38f3e15185749fbbed7d50575e0af6a for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:20.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4caba1d88f33479592499622388203ba for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:20.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet db06082c4313457fbbf84101e22144c2 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:20.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 879efd1361794a50a103929e547b582d for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:20.602 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=1b8c303050444b978d2ca60d12cf6663@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=e38f3e15185749fbbed7d50575e0af6a@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=4caba1d88f33479592499622388203ba@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=db06082c4313457fbbf84101e22144c2@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)[L],c03677bb70fe49339876d767c1854656(127.13.164.195:38081),ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=879efd1361794a50a103929e547b582d@[06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803),c03677bb70fe49339876d767c1854656(127.13.164.195:38081)[L],ca778b17fc924aba9d167da2ededa2a2(127.13.164.194:45355)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:20.602 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.13.164.252:40513, [4ms] Sub RPC GetTableLocations: received response from server master-127.13.164.252:40513: OK, deferred=null)) after lookup
12:13:20.608 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:20.610 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.610 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:20.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:20.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:20.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:20.613 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:20.613 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:20.616 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='fb8fdfe77d4d10a226e312db8560a95c9994d575b365ba34390e352be039fabe'}]
12:13:20.617 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0abbdfd720867f6df56a1bb8371addeabad22112f0600c5415619703b5c15319'}]
12:13:20.617 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7f007d979dfa91fadb8fde01206695c084e5cce9e7bb2a06a5e63bbcf234a4c1'}]
12:13:20.618 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.619 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5cf4c724dac2522761ada784c5be55d0d7fc1c9f35f41d3eba3a44078bfdd98f'}]
12:13:20.619 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:20.619 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:13:20.620 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:20.620 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299998, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:20.620 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:13:20.621 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299998, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:20.621 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:20.621 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:13:20.622 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:20.623 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:20.623 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:13:20.619 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.624 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299998, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:20.640 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.640 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.648 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.648 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.655 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:20.656 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:20.668 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=ebd236911db54f4bac13b7b9cbb4f652, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.669 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet ebd236911db54f4bac13b7b9cbb4f652 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=f074eebe7fc641aa82cd0f5a960efb46, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.680 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet f074eebe7fc641aa82cd0f5a960efb46 for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.700 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e909236b061042d583fcc54c35a1ed89, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.701 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet e909236b061042d583fcc54c35a1ed89 for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.714 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:20.714 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=590b08f86d964759845bbd0e012bf367, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.714 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 590b08f86d964759845bbd0e012bf367 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.726 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:20.729 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:20.729 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:20.729 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:20.730 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.730 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.730 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:20.731 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.731 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.731 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:20.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:20.732 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:20.735 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd0762c6ba7e4d2e88b05e270a68ca72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.745 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=1b8c303050444b978d2ca60d12cf6663, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 1b8c303050444b978d2ca60d12cf6663 for partition [0x0000000080000064, 0x00000000800000C8) with scanner id null
12:13:20.757 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=e38f3e15185749fbbed7d50575e0af6a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.757 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet e38f3e15185749fbbed7d50575e0af6a for partition [0x0000000180000064, 0x00000001800000C8) with scanner id null
12:13:20.770 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:20.785 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4caba1d88f33479592499622388203ba, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 4caba1d88f33479592499622388203ba for partition [0x0000000280000064, 0x00000002800000C8) with scanner id null
12:13:20.796 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=db06082c4313457fbbf84101e22144c2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.796 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet db06082c4313457fbbf84101e22144c2 for partition [0x0000000380000064, 0x00000003800000C8) with scanner id null
12:13:20.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=879efd1361794a50a103929e547b582d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.805 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state READY
12:13:20.806 [DEBUG - main] (Connection.java:575) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] disconnecting while in state READY
12:13:20.806 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state READY
12:13:20.806 [DEBUG - main] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state READY
12:13:20.806 [DEBUG - main] (Connection.java:575) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] disconnecting while in state READY
12:13:20.806 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:20.806 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:20.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:20.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:20.807 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] handling channelInactive
12:13:20.807 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] cleaning up while in state READY due to: connection closed
12:13:20.810 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:20.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:20.813 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:20.813 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:13:20.813 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-4
12:13:20.814 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:13:20.814 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:13:20.822 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:20.829 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:20.835 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:20.847 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:20.857 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] handling channelInactive
12:13:20.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] cleaning up while in state READY due to: connection closed
12:13:20.857 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
12:13:20.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:20.858788 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 14267
12:13:20.867 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:20.911 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.912 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:20.916 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb47af5ef, L:/127.0.0.1:39624 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:20.920 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:20.931 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.931 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512800930 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:20.935 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.938 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb1a73208, L:/127.0.0.1:39656 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:20.941 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2dcb1e64, L:/127.0.0.1:39634 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:20.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:20.957 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 8680f415d5d255088cd51ec1e8014bb4 (4514 bytes, checkpointDuration=26 ms, finalizationTime=1 ms).
12:13:20.959 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:13:20.968 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:20.979 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268431265792001) for scanner KuduScanner(table=replication_test_table, tablet=f074eebe7fc641aa82cd0f5a960efb46, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7f007d979dfa91fadb8fde01206695c084e5cce9e7bb2a06a5e63bbcf234a4c1]
12:13:20.980 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [7f007d979dfa91fadb8fde01206695c084e5cce9e7bb2a06a5e63bbcf234a4c1]
12:13:20.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:13:20.980 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:13:20.982 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268431265792001) for scanner KuduScanner(table=replication_test_table, tablet=e909236b061042d583fcc54c35a1ed89, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.982 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7f007d979dfa91fadb8fde01206695c084e5cce9e7bb2a06a5e63bbcf234a4c1 finished by subtask 1; deferring removal (restored in pending)
12:13:20.982 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [0abbdfd720867f6df56a1bb8371addeabad22112f0600c5415619703b5c15319]
12:13:20.983 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0abbdfd720867f6df56a1bb8371addeabad22112f0600c5415619703b5c15319]
12:13:20.983 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:13:20.983 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:13:20.983 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:20.984 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:20.984 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0abbdfd720867f6df56a1bb8371addeabad22112f0600c5415619703b5c15319 finished by subtask 2; deferring removal (restored in pending)
12:13:20.984 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='22d8e583e8a8c02916a583c654d33d6e0c9aa37112d09a986cf490350cbb562f'}]
12:13:20.986 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:20.988 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:20.989 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:20.993 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268431265792001) for scanner KuduScanner(table=replication_test_table, tablet=590b08f86d964759845bbd0e012bf367, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:20.993 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [5cf4c724dac2522761ada784c5be55d0d7fc1c9f35f41d3eba3a44078bfdd98f]
12:13:20.993 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5cf4c724dac2522761ada784c5be55d0d7fc1c9f35f41d3eba3a44078bfdd98f]
12:13:20.994 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:13:20.994 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:13:20.995 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5cf4c724dac2522761ada784c5be55d0d7fc1c9f35f41d3eba3a44078bfdd98f finished by subtask 0; deferring removal (restored in pending)
12:13:20.995 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:20.995 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:20.999 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe50353a0, L:/127.0.0.1:39640 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:21.003 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:13:21.004 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299997, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:21.025 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] handling channelInactive
12:13:21.026 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] cleaning up while in state READY due to: connection closed
12:13:21.033 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268431265792001) for scanner KuduScanner(table=replication_test_table, tablet=ebd236911db54f4bac13b7b9cbb4f652, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:21.033 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [fb8fdfe77d4d10a226e312db8560a95c9994d575b365ba34390e352be039fabe]
12:13:21.033 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [fb8fdfe77d4d10a226e312db8560a95c9994d575b365ba34390e352be039fabe]
12:13:21.034 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:13:21.034 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:13:21.034 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:21.035 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split fb8fdfe77d4d10a226e312db8560a95c9994d575b365ba34390e352be039fabe finished by subtask 3; deferring removal (restored in pending)
12:13:21.036 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:21.039 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] handling channelInactive
12:13:21.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] cleaning up while in state READY due to: connection closed
12:13:21.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:21.040566 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 14418
12:13:21.069 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:21.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:21.069 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:21.069 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:13:21.088 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:13:21.089 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:21.089 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:21.089 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:21.104 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:21.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:21.105 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:13:21.105 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:13:21.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:21.107491 14658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.164.193:45803: connect: Connection refused (error 111)
12:13:21.126 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:21.126 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:21.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:21.125648 14658 consensus_peers.cc:597] T 879efd1361794a50a103929e547b582d P c03677bb70fe49339876d767c1854656 -> Peer 06835ed424014fde8ab6c13d8ecf66a2 (127.13.164.193:45803): Couldn't send request to peer 06835ed424014fde8ab6c13d8ecf66a2. Status: Network error: Client connection negotiation failed: client connection to 127.13.164.193:45803: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:13:21.126 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:13:21.127 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:13:21.128 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:21.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:21.146772 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 14562
12:13:21.149 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:21.152 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:21.164 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:21.168 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62030efc, L:/127.0.0.1:39666 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:21.175 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268431265792001) for scanner KuduScanner(table=replication_test_table, tablet=bd0762c6ba7e4d2e88b05e270a68ca72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:21.176 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [22d8e583e8a8c02916a583c654d33d6e0c9aa37112d09a986cf490350cbb562f]
12:13:21.176 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [22d8e583e8a8c02916a583c654d33d6e0c9aa37112d09a986cf490350cbb562f]
12:13:21.176 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:13:21.176 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:13:21.177 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 22d8e583e8a8c02916a583c654d33d6e0c9aa37112d09a986cf490350cbb562f finished by subtask 1; deferring removal (restored in pending)
12:13:21.182 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:21.190 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:21.225 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:21.225 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:21.225 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:21.225 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:13:21.255 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] handling channelInactive
12:13:21.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] cleaning up while in state READY due to: connection closed
12:13:21.255 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] handling channelInactive
12:13:21.256 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] cleaning up while in state READY due to: connection closed
12:13:21.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:21.266392 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13983
12:13:21.281 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:21.282 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:21.282 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:21.283 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:21.283 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:21.283 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:21.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:21.283 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:21.284 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:21.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:21.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:21.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:21.285 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:21.332 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:21.332 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:21.333 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:21.333 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:21.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:21.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:21.334 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.13.164.254:45345(127.13.164.254:45345)] handling channelInactive
12:13:21.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state READY due to: connection closed
12:13:21.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:21.335723 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 14053
12:13:21.383 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:21.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:21.383 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:21.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:21.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:21.383526 13971 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 14130
12:13:21.384 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:21.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:21.383 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.13.164.253:36317(127.13.164.253:36317)] handling channelInactive
12:13:21.385 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state READY due to: connection closed
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.13.164.252:40513(127.13.164.252:40513)] handling channelInactive
12:13:21.420 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state READY due to: connection closed
12:13:21.429 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:21.429 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:21.429 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:21.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.430 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.430 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.430 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.430 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.430 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.430 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:21.434 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512801428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:21.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:21.459 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 8680f415d5d255088cd51ec1e8014bb4 (4514 bytes, checkpointDuration=31 ms, finalizationTime=0 ms).
12:13:21.461 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:13:21.461 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split fb8fdfe77d4d10a226e312db8560a95c9994d575b365ba34390e352be039fabe from pending
12:13:21.462 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 22d8e583e8a8c02916a583c654d33d6e0c9aa37112d09a986cf490350cbb562f from pending
12:13:21.462 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 0abbdfd720867f6df56a1bb8371addeabad22112f0600c5415619703b5c15319 from pending
12:13:21.462 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 7f007d979dfa91fadb8fde01206695c084e5cce9e7bb2a06a5e63bbcf234a4c1 from pending
12:13:21.462 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 5cf4c724dac2522761ada784c5be55d0d7fc1c9f35f41d3eba3a44078bfdd98f from pending
12:13:21.462 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 5 finished splits from enumerator state
12:13:21.715 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:21.715 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:21.716 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:21.716 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.717 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.717 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:21.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:21.717 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.717 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.717 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:21.717 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:21.930 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512801928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:21.945 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:13:21.946 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:13:21.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:22.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512802427 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:22.445 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:13:22.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:22.449 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:13:22.608 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 73237a28926d4473b710888f82fc2d93
12:13:22.617 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ebd236911db54f4bac13b7b9cbb4f652 for table 'replication_test_table' with partition [0x0000000080000064, 0x00000000800000C8)
12:13:22.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet f074eebe7fc641aa82cd0f5a960efb46 for table 'replication_test_table' with partition [0x0000000180000064, 0x00000001800000C8)
12:13:22.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet e909236b061042d583fcc54c35a1ed89 for table 'replication_test_table' with partition [0x0000000280000064, 0x00000002800000C8)
12:13:22.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 590b08f86d964759845bbd0e012bf367 for table 'replication_test_table' with partition [0x0000000380000064, 0x00000003800000C8)
12:13:22.618 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bd0762c6ba7e4d2e88b05e270a68ca72 for table 'replication_test_table' with partition [0x0000000480000064, 0x00000004800000C8)
12:13:22.618 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000080000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299999, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000000800000C8, upperBoundPartitionKey=0x0000000180000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299999, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000001800000C8, upperBoundPartitionKey=0x0000000280000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299999, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002800000C8, upperBoundPartitionKey=0x0000000380000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299999, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000003800000C8, upperBoundPartitionKey=0x0000000480000064, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299999, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000004800000C8, upperBoundPartitionKey=0x, ttl=299999}]
12:13:22.623 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='37639121f3323fee08e461491f3b22f762b84b5715f06fb6d5aaa55ee46845b9'}]
12:13:22.626 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:22.626 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:13:22.627 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000064, upperBoundPartitionKey=0x00000000800000C8, ttl=299998, tablet=ebd236911db54f4bac13b7b9cbb4f652@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:22.628 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6ea538648bda3bbdb58dbdecc02396769a0ab4e428f337501f7e4ba31d45cb11'}]
12:13:22.630 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:22.631 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='7f101ea717913a7b50917e9089f6e272f1a192bae4072dfd344d3c8db75e6117'}]
12:13:22.633 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:22.633 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8620ec68ce8b6a00714beae65e97b3e3ffedff8c221169986a86846d0e2cbab5'}]
12:13:22.635 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:22.636 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:13:22.637 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000064, upperBoundPartitionKey=0x00000001800000C8, ttl=299997, tablet=f074eebe7fc641aa82cd0f5a960efb46@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)[L],2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:22.637 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:13:22.638 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000280000064, upperBoundPartitionKey=0x00000002800000C8, ttl=299997, tablet=e909236b061042d583fcc54c35a1ed89@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)[L],1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)]}]
12:13:22.638 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:13:22.639 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000380000064, upperBoundPartitionKey=0x00000003800000C8, ttl=299997, tablet=590b08f86d964759845bbd0e012bf367@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:22.649 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:22.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:22.666 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:22.677 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:22.685 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:22.705 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:22.707 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:22.725 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:22.730 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:22.733 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:22.738 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:22.745 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:22.760 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:22.761 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:22.763 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:22.765 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x23513d0f, L:/127.0.0.1:39686 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:22.769 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:22.773 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x24c76950, L:/127.0.0.1:39672 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:22.774 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7a554573, L:/127.0.0.1:39698 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:22.776 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x307ba5cc, L:/127.0.0.1:39678 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:22.793 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268439457792001) for scanner KuduScanner(table=replication_test_table, tablet=ebd236911db54f4bac13b7b9cbb4f652, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:22.794 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [37639121f3323fee08e461491f3b22f762b84b5715f06fb6d5aaa55ee46845b9]
12:13:22.794 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [37639121f3323fee08e461491f3b22f762b84b5715f06fb6d5aaa55ee46845b9]
12:13:22.794 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:13:22.794 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:13:22.796 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 37639121f3323fee08e461491f3b22f762b84b5715f06fb6d5aaa55ee46845b9 finished by subtask 2; deferring removal (restored in pending)
12:13:22.796 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:22.797 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5c2e1ffdb3cc2b881f37bca083b83c5e7e9ffffcf142a7d2ce6808d8576f0b47'}]
12:13:22.799 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:22.801 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:22.808 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:13:22.816 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000480000064, upperBoundPartitionKey=0x00000004800000C8, ttl=299994, tablet=bd0762c6ba7e4d2e88b05e270a68ca72@[0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745),1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781),2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)[L]]}]
12:13:22.819 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268439457792001) for scanner KuduScanner(table=replication_test_table, tablet=590b08f86d964759845bbd0e012bf367, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:22.820 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8620ec68ce8b6a00714beae65e97b3e3ffedff8c221169986a86846d0e2cbab5]
12:13:22.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8620ec68ce8b6a00714beae65e97b3e3ffedff8c221169986a86846d0e2cbab5]
12:13:22.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:13:22.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:13:22.821 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8620ec68ce8b6a00714beae65e97b3e3ffedff8c221169986a86846d0e2cbab5 finished by subtask 1; deferring removal (restored in pending)
12:13:22.822 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:22.822 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:22.833 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268439457792001) for scanner KuduScanner(table=replication_test_table, tablet=f074eebe7fc641aa82cd0f5a960efb46, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:22.833 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [6ea538648bda3bbdb58dbdecc02396769a0ab4e428f337501f7e4ba31d45cb11]
12:13:22.836 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6ea538648bda3bbdb58dbdecc02396769a0ab4e428f337501f7e4ba31d45cb11]
12:13:22.837 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:13:22.837 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:13:22.838 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6ea538648bda3bbdb58dbdecc02396769a0ab4e428f337501f7e4ba31d45cb11 finished by subtask 0; deferring removal (restored in pending)
12:13:22.838 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:22.839 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:22.854 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:22.854 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:22.854 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:13:22.855 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:13:22.867 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] connecting to peer
12:13:22.904 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] Successfully connected to peer
12:13:22.907 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.12.238.195
12:13:22.925 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:22.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:22.925 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:22.925 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:13:22.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512802928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:22.938 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:22.943 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 8680f415d5d255088cd51ec1e8014bb4 (4514 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
12:13:22.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:22.949 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:13:22.949 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 37639121f3323fee08e461491f3b22f762b84b5715f06fb6d5aaa55ee46845b9 from pending
12:13:22.949 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 6ea538648bda3bbdb58dbdecc02396769a0ab4e428f337501f7e4ba31d45cb11 from pending
12:13:22.949 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 8620ec68ce8b6a00714beae65e97b3e3ffedff8c221169986a86846d0e2cbab5 from pending
12:13:22.949 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
12:13:22.960 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x04be3a44, L:/127.0.0.1:39706 - R:/127.12.238.195:41959] using SASL/PLAIN
12:13:22.968 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268439457792001) for scanner KuduScanner(table=replication_test_table, tablet=bd0762c6ba7e4d2e88b05e270a68ca72, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:22.968 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:22.968 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:22.968 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:13:22.969 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:23.039 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [5c2e1ffdb3cc2b881f37bca083b83c5e7e9ffffcf142a7d2ce6808d8576f0b47]
12:13:23.039 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:23.040 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:23.040 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:23.040 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:23.040 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:23.041 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.041 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:23.041 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.041 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.042 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.042 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:23.044 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5c2e1ffdb3cc2b881f37bca083b83c5e7e9ffffcf142a7d2ce6808d8576f0b47]
12:13:23.045 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.045 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.045 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.045 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:13:23.045 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:13:23.045 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.045 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.045 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.045 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.046 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:23.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:23.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:23.046 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:23.047 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5c2e1ffdb3cc2b881f37bca083b83c5e7e9ffffcf142a7d2ce6808d8576f0b47 finished by subtask 2; deferring removal (restored in pending)
12:13:23.048 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:23.048 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:23.085 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:23.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:23.085 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:23.085 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:13:23.194 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268439457792001) for scanner KuduScanner(table=replication_test_table, tablet=e909236b061042d583fcc54c35a1ed89, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:13:23.194 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [7f101ea717913a7b50917e9089f6e272f1a192bae4072dfd344d3c8db75e6117]
12:13:23.195 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [7f101ea717913a7b50917e9089f6e272f1a192bae4072dfd344d3c8db75e6117]
12:13:23.195 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:13:23.195 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:13:23.197 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 7f101ea717913a7b50917e9089f6e272f1a192bae4072dfd344d3c8db75e6117 finished by subtask 3; deferring removal (restored in pending)
12:13:23.199 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:23.202 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:23.242 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:23.242 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:23.242 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:13:23.243 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:13:23.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:23Z chronyd exiting
12:13:23.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512803428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:23.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:23.449 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 8680f415d5d255088cd51ec1e8014bb4 (2384 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:13:23.450 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:13:23.451 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 7f101ea717913a7b50917e9089f6e272f1a192bae4072dfd344d3c8db75e6117 from pending
12:13:23.451 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 5c2e1ffdb3cc2b881f37bca083b83c5e7e9ffffcf142a7d2ce6808d8576f0b47 from pending
12:13:23.451 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 2 finished splits from enumerator state
12:13:23.720 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:23.721 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:23.721 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:23.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:23.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:23.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:23.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:23.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:23.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:23.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:23.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:23.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:23.722 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:23.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512803928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:23.943 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:23.943 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:13:23.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:24.329 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state READY
12:13:24.329 [DEBUG - main] (Connection.java:575) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] disconnecting while in state READY
12:13:24.329 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state READY
12:13:24.329 [DEBUG - main] (Connection.java:575) [peer 1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)] disconnecting while in state READY
12:13:24.329 [DEBUG - main] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state READY
12:13:24.330 [DEBUG - main] (Connection.java:575) [peer 0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)] disconnecting while in state READY
12:13:24.330 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.238.252:39469(127.12.238.252:39469)] handling channelInactive
12:13:24.330 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state READY due to: connection closed
12:13:24.331 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)] handling channelInactive
12:13:24.331 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 1453da96a7f74ffcb7c36fb05288897d(127.12.238.194:41781)] cleaning up while in state READY due to: connection closed
12:13:24.331 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] handling channelInactive
12:13:24.331 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2b922a4a5f4548ec9bece88a0923e4b9(127.12.238.195:41959)] cleaning up while in state READY due to: connection closed
12:13:24.331 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:24.332 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
12:13:24.330 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.238.253:35475(127.12.238.253:35475)] handling channelInactive
12:13:24.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state READY due to: connection closed
12:13:24.333 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:13:24.333 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
12:13:24.336 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
12:13:24.330 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.238.254:35497(127.12.238.254:35497)] handling channelInactive
12:13:24.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state READY due to: connection closed
12:13:24.337 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:13:24.358 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)] handling channelInactive
12:13:24.358 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 0c9ee0fd08004f7d883e3a7b945f92ae(127.12.238.193:33745)] cleaning up while in state READY due to: connection closed
12:13:24.358 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
12:13:24.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.362324 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13544
12:13:24.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.422978 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13687
12:13:24.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512804428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:24.441 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:13:24.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:24.449 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:13:24.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:24.493050 13848 connection.cc:573] client connection to 127.12.238.194:41781 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:13:24.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:24.493479 13848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:13:24.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.503908 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13827
12:13:24.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.541047 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13255
12:13:24.565 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.238.254:35497(127.12.238.254:35497)] handling channelInactive
12:13:24.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state READY due to: connection closed
12:13:24.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.565475 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13325
12:13:24.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:24.597719 13243 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 13401
12:13:24.601 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.238.253:35475(127.12.238.253:35475)] handling channelInactive
12:13:24.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state READY due to: connection closed
12:13:24.626 [ERROR - kudu-nio-1] (Connection.java:452) [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:24.626 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state READY due to: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469]
12:13:24.626 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.12.238.252:39469(127.12.238.252:39469) for tablet Kudu Master: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469]
12:13:24.627 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.238.252:39469(127.12.238.252:39469)] handling channelInactive
12:13:24.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.640 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.640 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.641 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.642 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.660 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.661 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.661 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.661 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.661 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.662 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.662 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.680 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.680 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.680 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.680 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.680 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.681 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.699 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.700 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.700 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.700 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.700 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.701 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.701 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.701 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.701 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.701 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.739 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.740 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.741 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.799 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.799 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.799 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.799 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.800 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.800 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.800 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.801 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.859 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:24.859 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:24.860 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:24.860 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.860 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.860 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:24.860 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.860 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.860 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.860 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.861 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:24.861 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:24.861 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:24.895 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:24.896 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:24.896 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:24.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:24.897 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:24.897 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:24.897 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:24.897 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:24.897 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:24.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:24.897 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:24.897 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:24.897 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:24.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512804928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:24.939 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:13:24.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:13:24.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:25.019 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:25.019 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:25.020 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:25.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.020 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.020 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.021 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:25.299 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:25.300 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:25.300 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:25.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.301 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.301 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.301 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.301 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.301 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:25.308 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:25.309 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:25.309 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:25.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:25.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:25.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:25.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:25.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:25.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:25.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:25.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:25.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:25.310 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:25.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512805428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:25.441 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:25.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
12:13:25.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:25.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:25Z chronyd exiting
12:13:25.899 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:25.899 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:25.900 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:25.900 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.900 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.900 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.900 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.900 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.900 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:25.900 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:25.900 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.900 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:25.900 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:25.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512805927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:25.938 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:13:25.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:13:25.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:26.149 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:26.149 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:26.150 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:26.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.150 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.150 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.151 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.151 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:26.391 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:26.391 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:26.391 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:26.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.392 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.392 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.392 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.392 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.392 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.392 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.392 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:26.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512806428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:26.435 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:13:26.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:13:26.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:26.593 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:26.594 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:26.594 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:26.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:26.594 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.595 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:26.595 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.595 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.595 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:26.595 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
.12:13:26.713 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512806713
12:13:26.713 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512806713
12:13:26.716 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:13:26.719 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:13:26.719 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:13:26.719 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:13:26.719 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:13:26.719 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:13:26.722 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:13:26.819 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:26.819 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:26.819 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:26.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:26.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:26.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:26.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:26.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:26.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:26.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:26.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:26.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:26.820 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:26.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512806928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:26.936 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:13:26.937 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:13:26.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:27.041 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:13:27.041 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:13:27.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.044450 15293 mini_oidc.cc:150] Starting JWKS server
12:13:27.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.047518 15293 webserver.cc:533] Webserver started at http://127.0.0.1:33323/ using document root <none> and password file <none>
12:13:27.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.047904 15293 mini_oidc.cc:186] Starting OIDC Discovery server
12:13:27.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.049516 15293 webserver.cc:533] Webserver started at http://127.0.0.1:34421/ using document root <none> and password file <none>
12:13:27.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:27Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:13:27.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:27Z Disabled control of system clock
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.107734 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/logs
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data/info.pb
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.126:41849
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.126
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:27.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json with env {}
12:13:27.235 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:27.236 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:27.236 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:27.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:27.236 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:27.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:27.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:27.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:27.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:27.237 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:27.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:27.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:27.237 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.400632 15305 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.401194 15305 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:27.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.401661 15305 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:27.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512807428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:27.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.435571 15305 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:27.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.435926 15305 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:27.436 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:13:27.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.436270 15305 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:27.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.436628 15305 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:27.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:13:27.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.437120 15305 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:27.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.437409 15305 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33323/jwks.json
12:13:27.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.474169 15305 master_runner.cc:387] Master server non-default flags:
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.126:41849
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data/info.pb
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.126
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:27.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/logs
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:27.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.475467 15305 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:27.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:27.477046 15305 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:27.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.488226 15311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:27.561 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:27.562 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:27.562 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:27.562 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:27.562 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:27.562 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:27.563 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:27.563 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:27.563 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:27.563 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:27.563 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:27.563 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:27.563 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:27.930 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512807928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:27.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:27.950 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
12:13:27.952 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:13:28.173 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:28.174 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:28.174 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:28.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.177 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.177 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:28.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512808428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:28.441 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:28.445 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:13:28.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:28.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:27.488451 15312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:28.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.643702 15314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:28.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.645977 15313 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1153 milliseconds
12:13:28.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.648898 15305 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.161s	user 0.363s	sys 0.795s
12:13:28.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.649387 15305 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.162s	user 0.363s	sys 0.796s
12:13:28.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.649682 15305 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:28.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.651137 15305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:28.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.654249 15305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:28.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.655670 15305 hybrid_clock.cc:648] HybridClock initialized: now 1783512808655593 us; error 77 us; skew 500 ppm
12:13:28.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.656775 15305 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:28.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.665256 15305 webserver.cc:533] Webserver started at http://127.14.239.126:34417/ using document root <none> and password file <none>
12:13:28.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.666491 15305 fs_manager.cc:362] Metadata directory not provided
12:13:28.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.666770 15305 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:28.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.667315 15305 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:28.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.673429 15305 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data/instance:
12:13:28.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8cdd143d89fb43e988b2d603b3a179ae"
12:13:28.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:28 on dist-test-slave-vcgh"
12:13:28.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.674880 15305 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal/instance:
12:13:28.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8cdd143d89fb43e988b2d603b3a179ae"
12:13:28.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:28 on dist-test-slave-vcgh"
12:13:28.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.683060 15305 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.005s
12:13:28.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.689039 15321 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.690124 15305 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
12:13:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.690433 15305 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal
12:13:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8cdd143d89fb43e988b2d603b3a179ae"
12:13:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:28 on dist-test-slave-vcgh"
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.690727 15305 fs_report.cc:389] FS layout report
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data/data
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:28.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.762823 15305 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:28.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.764302 15305 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:28.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.764730 15305 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:28.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.832326 15305 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.126:41849
12:13:28.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.832394 15372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.126:41849 every 8 connection(s)
12:13:28.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.834944 15305 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/data/info.pb
12:13:28.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.840837 15373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.843029 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15305
12:13:28.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.843518 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-0/wal/instance
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.848594 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/logs
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data/info.pb
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.125:46113
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.125
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:28.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json with env {}
12:13:28.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.855113 15373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } has no permanent_uuid. Determining permanent_uuid...
12:13:28.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.883775 15373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
12:13:28.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.886080 15324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:28.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.890070 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:28.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512808928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:28.929 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:28.930 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:28.930 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:28.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:28.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.931 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.931 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:28.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:28.931 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:28.939 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:28.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:28.939671 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 1
12:13:28.941 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:13:28.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:28.945169 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:28.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:29.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.013654 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 2
12:13:29.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.018292 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:29.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.109669 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 3
12:13:29.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.113620 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:29.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.160455 15375 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:29.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.161118 15375 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:29.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.161660 15375 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:29.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.193796 15375 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:29.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.194130 15375 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:29.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.194430 15375 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:29.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.194705 15375 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:29.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.194981 15375 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:29.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.195190 15375 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33323/jwks.json
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.234045 15375 master_runner.cc:387] Master server non-default flags:
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.125:46113
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data/info.pb
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.125
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:29.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/logs
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:29.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.235610 15375 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:29.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.237360 15375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:29.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.248165 15384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:29.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.257050 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 4
12:13:29.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.263602 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:29.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512809428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:29.441 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:13:29.445 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:13:29.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:29.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:29.563097 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 5
12:13:29.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.569998 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:29.614 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:29.614 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:29.615 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:29.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.616 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.616 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:29.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512809928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:29.946 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:13:29.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:29.947 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:13:29.989 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:29.990 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:29.990 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:29.990 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:29.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:29.991 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.991 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:29.991 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:30.031 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:30.031 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:30.032 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:30.032 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.032 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.033 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.033 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:30.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.117467 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 6
12:13:30.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.144300 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.125:46113: Network error: Client connection negotiation failed: client connection to 127.14.239.125:46113: connect: Connection refused (error 111)
12:13:30.239 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:30.239 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:30.240 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:30.240 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:30.240 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:30.240 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:30.241 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:30.241 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:30.241 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:30.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:30.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:30.241 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:30.241 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:30.333 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:30.334 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:30.335 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:30.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.337 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.337 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.337 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.338 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.338 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:30.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512810428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:30.442 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:30.444 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:13:30.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:30.715 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:30.716 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:30.716 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:30.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:30.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.721 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:30.721 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:30.722 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:30.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.649935 15383 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 15375
12:13:30.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.809360 15375 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.561s	user 0.645s	sys 0.914s
12:13:30.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.809716 15375 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.561s	user 0.646s	sys 0.915s
12:13:30.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:29.249346 15385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:30.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.810889 15386 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1561 milliseconds
12:13:30.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.811890 15375 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:30.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:30.811964 15387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:30.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.816203 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:30.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.818548 15375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.819941 15375 hybrid_clock.cc:648] HybridClock initialized: now 1783512810819864 us; error 74 us; skew 500 ppm
12:13:30.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.820782 15375 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:30.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.826604 15375 webserver.cc:533] Webserver started at http://127.14.239.125:46803/ using document root <none> and password file <none>
12:13:30.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.827477 15375 fs_manager.cc:362] Metadata directory not provided
12:13:30.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.827661 15375 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:30.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.828032 15375 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:30.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.832175 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data/instance:
12:13:30.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d69773ae7884462a33a461411576e7c"
12:13:30.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:30 on dist-test-slave-vcgh"
12:13:30.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.833232 15375 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal/instance:
12:13:30.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d69773ae7884462a33a461411576e7c"
12:13:30.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:30 on dist-test-slave-vcgh"
12:13:30.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.840572 15375 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.005s
12:13:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.846331 15397 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.847379 15375 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.847703 15375 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d69773ae7884462a33a461411576e7c"
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:30 on dist-test-slave-vcgh"
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.848050 15375 fs_report.cc:389] FS layout report
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data/data
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:30.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.894425 15375 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:30.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.895916 15375 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:30.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.896389 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:30.930 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512810928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:30.940 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:13:30.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:13:30.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:30.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.970232 15375 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.125:46113
12:13:30.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.970356 15448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.125:46113 every 8 connection(s)
12:13:30.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.972906 15375 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/data/info.pb
12:13:30.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.977425 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15375
12:13:30.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.977751 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-1/wal/instance
12:13:30.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.978672 15449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:30.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.979620 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:30.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:30.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/logs
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data/info.pb
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.124:41311
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.124
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:30.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json with env {}
12:13:30.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:30.991592 15449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } has no permanent_uuid. Determining permanent_uuid...
12:13:31.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.014057 15449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
12:13:31.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.028328 15449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } has no permanent_uuid. Determining permanent_uuid...
12:13:31.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.031018 15398 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.035280 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.084793 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 1
12:13:31.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.088909 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.157287 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 2
12:13:31.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.161506 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.204790 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } attempt: 7
12:13:31.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.215731 15373 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } has no permanent_uuid. Determining permanent_uuid...
12:13:31.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.221309 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.252854 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 3
12:13:31.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.256776 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.279732 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 1
12:13:31.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.283329 15451 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:31.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.283794 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.284155 15451 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:31.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.284626 15451 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:31.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.316383 15451 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:31.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.316745 15451 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:31.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.316947 15451 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:31.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.317147 15451 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:31.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.317334 15451 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:31.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.317495 15451 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33323/jwks.json
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.353857 15451 master_runner.cc:387] Master server non-default flags:
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.124:41311
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33323/jwks.json
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data/info.pb
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.124
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/logs
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.355336 15451 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:31.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.356947 15451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:31.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.365211 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 2
12:13:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.367110 15463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:31.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.370748 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.400229 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 4
12:13:31.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.405648 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512811428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:31.443 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:13:31.444 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:13:31.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:31.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.456141 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 3
12:13:31.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.462786 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.500 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:31.501 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:31.501 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:31.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:31.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:31.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:31.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:31.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:31.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:31.504 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:31.504 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:31.504 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:31.504 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:31.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.603259 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 4
12:13:31.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.609941 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.705112 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 5
12:13:31.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.712894 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:31.893388 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 5
12:13:31.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.900409 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:31.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512811928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:31.946 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:13:31.948 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:13:31.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:32.249 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:32.249 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:32.250 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:32.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.251 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.252 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.253 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.253 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.253 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:32.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.260353 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 6
12:13:32.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.288266 15449 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:32.329 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:32.329 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:32.330 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:32.331 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.331 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.331 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.331 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.331 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.331 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.332 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.332 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:32.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512812428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:32.442 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:32.444 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:13:32.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:32.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.453195 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 6
12:13:32.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.476837 15373 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.239.124:41311: Network error: Client connection negotiation failed: client connection to 127.14.239.124:41311: connect: Connection refused (error 111)
12:13:32.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:31.368062 15464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:32.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.770210 15462 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 15451
12:13:32.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.917711 15451 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.549s	user 0.609s	sys 0.937s
12:13:32.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.918741 15451 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.550s	user 0.609s	sys 0.938s
12:13:32.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.920203 15466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:32.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:32.922048 15465 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1550 milliseconds
12:13:32.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.922109 15451 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:32.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.923347 15451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:32.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.925699 15451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:32.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.927026 15451 hybrid_clock.cc:648] HybridClock initialized: now 1783512812926993 us; error 34 us; skew 500 ppm
12:13:32.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.927809 15451 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:32.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512812927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:32.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.936374 15451 webserver.cc:533] Webserver started at http://127.14.239.124:35653/ using document root <none> and password file <none>
12:13:32.937 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:32.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.937345 15451 fs_manager.cc:362] Metadata directory not provided
12:13:32.938 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:13:32.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.937729 15451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:32.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.938453 15451 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:32.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.942720 15451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data/instance:
12:13:32.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95370d67894c4a15bc71a11bf198cef8"
12:13:32.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:32 on dist-test-slave-vcgh"
12:13:32.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.943816 15451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal/instance:
12:13:32.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95370d67894c4a15bc71a11bf198cef8"
12:13:32.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:32 on dist-test-slave-vcgh"
12:13:32.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:32.951 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:32.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.951112 15451 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.005s
12:13:32.951 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:32.951 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:32.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.952 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:32.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.952 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:32.952 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.952 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:32.952 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:32.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.957209 15477 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:32.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.958244 15451 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
12:13:32.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.958510 15451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal
12:13:32.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95370d67894c4a15bc71a11bf198cef8"
12:13:32.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:32 on dist-test-slave-vcgh"
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:32.958819 15451 fs_report.cc:389] FS layout report
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data/data
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:32.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:33.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.017494 15451 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:33.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.018919 15451 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:33.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.019325 15451 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.087180 15451 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.124:41311
12:13:33.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.087280 15528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.124:41311 every 8 connection(s)
12:13:33.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.089802 15451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/data/info.pb
12:13:33.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.090745 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15451
12:13:33.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.091318 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/master-2/wal/instance
12:13:33.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.096403 15529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:33.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.111764 15529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } has no permanent_uuid. Determining permanent_uuid...
12:13:33.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.134678 15529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } has no permanent_uuid. Determining permanent_uuid...
12:13:33.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.143126 15529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } has no permanent_uuid. Determining permanent_uuid...
12:13:33.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.158457 15529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: Bootstrap starting.
12:13:33.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.164989 15529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: Neither blocks nor log segments found. Creating new log.
12:13:33.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.166680 15529 log.cc:826] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: Log is configured to *not* fsync() on all Append() calls
12:13:33.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.171594 15529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: No bootstrap required, opened a new log
12:13:33.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.189520 15529 raft_consensus.cc:359] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.190405 15529 raft_consensus.cc:385] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:33.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.190708 15529 raft_consensus.cc:740] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95370d67894c4a15bc71a11bf198cef8, State: Initialized, Role: FOLLOWER
12:13:33.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.191642 15529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.193838 15538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.194509 15538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.195166 15529 sys_catalog.cc:565] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: configured and running, proceeding with master startup.
12:13:33.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:33.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:33.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.219606 15549 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:13:33.220 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:33.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:33.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.219908 15549 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:13:33.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:33.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:33.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:33.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:33.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:33.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:33.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:33.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:33.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:33.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.214257 15451 master_runner.cc:187] Error getting master registration for 127.14.239.126:41849: OK, instance_id { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" instance_seqno: 1783512808813916 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:33.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.237052 15451 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:33.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.274206 15483 tablet.cc:2406] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:33.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.337261 15538 raft_consensus.cc:493] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:33.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.337787 15538 raft_consensus.cc:515] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.339959 15538 leader_election.cc:290] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cdd143d89fb43e988b2d603b3a179ae (127.14.239.126:41849), 1d69773ae7884462a33a461411576e7c (127.14.239.125:46113)
12:13:33.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.348747 15449 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 7
12:13:33.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.369714 15449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: Bootstrap starting.
12:13:33.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.376984 15449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: Neither blocks nor log segments found. Creating new log.
12:13:33.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.379246 15449 log.cc:826] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: Log is configured to *not* fsync() on all Append() calls
12:13:33.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.384168 15449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: No bootstrap required, opened a new log
12:13:33.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.411262 15449 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.412076 15449 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:33.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.412376 15449 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d69773ae7884462a33a461411576e7c, State: Initialized, Role: FOLLOWER
12:13:33.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.413616 15449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.417088 15553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.418645 15553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.419605 15449 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: configured and running, proceeding with master startup.
12:13:33.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.419760 15424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95370d67894c4a15bc71a11bf198cef8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d69773ae7884462a33a461411576e7c" is_pre_election: true
12:13:33.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.420593 15424 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95370d67894c4a15bc71a11bf198cef8 in term 0.
12:13:33.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.421972 15480 leader_election.cc:304] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d69773ae7884462a33a461411576e7c, 95370d67894c4a15bc71a11bf198cef8; no voters: 
12:13:33.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.423039 15538 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:33.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.423418 15538 raft_consensus.cc:493] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:33.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.423736 15538 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 0 FOLLOWER]: Advancing to term 1
12:13:33.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512813428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:33.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.430160 15538 raft_consensus.cc:515] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.432016 15538 leader_election.cc:290] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [CANDIDATE]: Term 1 election: Requested vote from peers 8cdd143d89fb43e988b2d603b3a179ae (127.14.239.126:41849), 1d69773ae7884462a33a461411576e7c (127.14.239.125:46113)
12:13:33.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.439541 15424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95370d67894c4a15bc71a11bf198cef8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d69773ae7884462a33a461411576e7c"
12:13:33.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.440061 15424 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 0 FOLLOWER]: Advancing to term 1
12:13:33.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.446564 15424 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95370d67894c4a15bc71a11bf198cef8 in term 1.
12:13:33.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:33.449 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:13:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.450053 15480 leader_election.cc:304] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d69773ae7884462a33a461411576e7c, 95370d67894c4a15bc71a11bf198cef8; no voters: 
12:13:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.450691 15538 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 1 FOLLOWER]: Leader election won for term 1
12:13:33.454 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:13:33.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.484598 15538 raft_consensus.cc:697] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [term 1 LEADER]: Becoming Leader. State: Replica: 95370d67894c4a15bc71a11bf198cef8, State: Running, Role: LEADER
12:13:33.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.485860 15538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.507675 15557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95370d67894c4a15bc71a11bf198cef8. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.508539 15557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: This master's current role is: LEADER
12:13:33.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.510277 15373 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } attempt: 7
12:13:33.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.523811 15561 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:13:33.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.537343 15561 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:13:33.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.543484 15373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: Bootstrap starting.
12:13:33.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.550941 15373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: Neither blocks nor log segments found. Creating new log.
12:13:33.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.553432 15373 log.cc:826] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: Log is configured to *not* fsync() on all Append() calls
12:13:33.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.575651 15424 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [term 1 FOLLOWER]: Refusing update from remote peer 95370d67894c4a15bc71a11bf198cef8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:33.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.579006 15557 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:33.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.594995 15373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: No bootstrap required, opened a new log
12:13:33.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.595570 15570 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:13:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.597589 15570 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:13:33.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.654098 15403 tablet.cc:2406] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:33.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.582300 15375 master_runner.cc:187] Error getting master registration for 127.14.239.126:41849: OK, instance_id { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" instance_seqno: 1783512808813916 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:33.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.669193 15375 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:33.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.682211 15553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95370d67894c4a15bc71a11bf198cef8. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.682917 15553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.694701 15373 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.699201 15373 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:33.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.699766 15373 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cdd143d89fb43e988b2d603b3a179ae, State: Initialized, Role: FOLLOWER
12:13:33.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.699751 15569 mvcc.cc:204] Tried to move back new op lower bound from 7305268484374093824 to 7305268484049174528. Current Snapshot: MvccSnapshot[applied={T|T < 7305268484374093824}]
12:13:33.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.700511 15572 mvcc.cc:204] Tried to move back new op lower bound from 7305268484374093824 to 7305268484049174528. Current Snapshot: MvccSnapshot[applied={T|T < 7305268484374093824}]
12:13:33.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.700946 15373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.703076 15557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.703704 15557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: This master's current role is: LEADER
12:13:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.706903 15561 catalog_manager.cc:1383] Generated new cluster ID: 2a6691556f8a4be7ba18644ea8684580
12:13:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.707187 15561 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:13:33.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.708806 15553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.709476 15553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.725504 15347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95370d67894c4a15bc71a11bf198cef8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cdd143d89fb43e988b2d603b3a179ae"
12:13:33.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.726025 15348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95370d67894c4a15bc71a11bf198cef8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cdd143d89fb43e988b2d603b3a179ae" is_pre_election: true
12:13:33.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.727213 15346 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 0 FOLLOWER]: Advancing to term 1
12:13:33.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.733840 15346 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 1 FOLLOWER]: Refusing update from remote peer 95370d67894c4a15bc71a11bf198cef8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.735378 15576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.736235 15576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.725229 15373 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: configured and running, proceeding with master startup.
12:13:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.739988 15538 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.740398 15576 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.740862 15576 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } }
12:13:33.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.743969 15423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8cdd143d89fb43e988b2d603b3a179ae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d69773ae7884462a33a461411576e7c" is_pre_election: true
12:13:33.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.745718 15561 catalog_manager.cc:1406] Generated new certificate authority record
12:13:33.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.745435 15504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8cdd143d89fb43e988b2d603b3a179ae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95370d67894c4a15bc71a11bf198cef8" is_pre_election: true
12:13:33.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.747612 15561 catalog_manager.cc:1540] Loading token signing keys...
12:13:33.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.752280 15322 leader_election.cc:304] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cdd143d89fb43e988b2d603b3a179ae; no voters: 1d69773ae7884462a33a461411576e7c, 95370d67894c4a15bc71a11bf198cef8
12:13:33.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.766458 15576 leader_election.cc:290] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d69773ae7884462a33a461411576e7c (127.14.239.125:46113), 95370d67894c4a15bc71a11bf198cef8 (127.14.239.124:41311)
12:13:33.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:33.774380 15327 tablet.cc:2406] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:33.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.796573 15561 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8: Generated new TSK 0
12:13:33.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.797647 15561 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:13:33.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.799472 15576 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
12:13:33.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.800872 15579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.801565 15579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95370d67894c4a15bc71a11bf198cef8 [sys.catalog]: This master's current role is: LEADER
12:13:33.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.802824 15580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.803612 15580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.805331 15577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95370d67894c4a15bc71a11bf198cef8. Latest consensus state: current_term: 1 leader_uuid: "95370d67894c4a15bc71a11bf198cef8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cdd143d89fb43e988b2d603b3a179ae" member_type: VOTER last_known_addr { host: "127.14.239.126" port: 41849 } } peers { permanent_uuid: "1d69773ae7884462a33a461411576e7c" member_type: VOTER last_known_addr { host: "127.14.239.125" port: 46113 } } peers { permanent_uuid: "95370d67894c4a15bc71a11bf198cef8" member_type: VOTER last_known_addr { host: "127.14.239.124" port: 41311 } } }
12:13:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.806138 15577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae [sys.catalog]: This master's current role is: FOLLOWER
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.837844 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/logs
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data/info.pb
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.65:0
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.65
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.65
12:13:33.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:33.901 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:33.901 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:33.902 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:33.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:33.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:33.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:33.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:33.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:33.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:33.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:33.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:33.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:33.903 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:33.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512813928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:33.938 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:33.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:13:33.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:33.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.963116 15595 catalog_manager.cc:1295] Loaded cluster ID: 2a6691556f8a4be7ba18644ea8684580
12:13:33.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.963399 15595 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: loading cluster ID for follower catalog manager: success
12:13:33.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.975476 15595 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: acquiring CA information for follower catalog manager: success
12:13:33.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:33.980739 15595 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 8cdd143d89fb43e988b2d603b3a179ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:34.001 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:34.001 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:34.002 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:34.002 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:34.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:34.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:34.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:34.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:34.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:34.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:34.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:34.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:34.002 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:34.194 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:34.194 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:34.194 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:34.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.195 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.196 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.196 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.197 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.197 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:34.250 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:34.250 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:34.251 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:34.251 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.251 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.251 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.252 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:34.254 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:34.255 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:34.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.255 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:34.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:34.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:34.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:34.256 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:34.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512814428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:34.440 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:13:34.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:13:34.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:34.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.529676 15590 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:34.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.530310 15590 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:34.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.531065 15590 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:34.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.591123 15590 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:34.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.592458 15590 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.239.65
12:13:34.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.611559 15570 catalog_manager.cc:1295] Loaded cluster ID: 2a6691556f8a4be7ba18644ea8684580
12:13:34.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.611855 15570 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: loading cluster ID for follower catalog manager: success
12:13:34.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.623128 15570 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: acquiring CA information for follower catalog manager: success
12:13:34.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.638675 15570 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1d69773ae7884462a33a461411576e7c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.672221 15590 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.65:0
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data/info.pb
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.65
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.65
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/logs
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.678340 15590 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:34.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:34.680657 15590 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:34.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.714821 15602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:34.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512814928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:34.945 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:13:34.945 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:13:34.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:35.099 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:35.099 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:35.100 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:35.100 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:35.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:35.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:35.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:35.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:35.101 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:35.101 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:35.100 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:35.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:35.101 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:35.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512815428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:35.438 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:13:35.439 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:13:35.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:35.649 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:35.650 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:35.650 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:35.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.652 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.652 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.652 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.653 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.653 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.653 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.653 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:35.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512815928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:35.940 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:13:35.942 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:13:35.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:35.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:35.955 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:35.956 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:35.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.956 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:35.956 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.956 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:35.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:35.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:36.414 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:36.414 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:36.414 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:36.415 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:36.415 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:36.415 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:36.415 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:36.415 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:36.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:36.416 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:36.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:36.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:36.416 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:36.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512816428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:36.445 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:13:36.447 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:13:36.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:36.840 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:36.841 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:36.841 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:36.841 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:36.841 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:36.841 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:36.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:36.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:36.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:36.842 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:36.842 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:36.842 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:36.842 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:36.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512816927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:36.937 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:34.720880 15603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:36.108462 15601 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 15590
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:36.938403 15601 kernel_stack_watchdog.cc:198] Thread 15590 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 388ms:
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:13:36.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:13:36.941 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:13:36.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:36.942420 15590 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.224s	user 0.487s	sys 0.795s
12:13:36.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:36.942852 15590 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.224s	user 0.487s	sys 0.795s
12:13:36.948 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:36.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:36.949189 15608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:36.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.949270 15590 server_base.cc:1061] running on GCE node
12:13:36.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.950675 15590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:36.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.953132 15590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:36.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.954561 15590 hybrid_clock.cc:648] HybridClock initialized: now 1783512816954454 us; error 89 us; skew 500 ppm
12:13:36.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.955643 15590 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:36.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.962901 15590 webserver.cc:533] Webserver started at http://127.14.239.65:39389/ using document root <none> and password file <none>
12:13:36.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.963994 15590 fs_manager.cc:362] Metadata directory not provided
12:13:36.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.964275 15590 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:36.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.964824 15590 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:36.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.970678 15590 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data/instance:
12:13:36.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1562194b6164ee6838699499610e490"
12:13:36.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:36 on dist-test-slave-vcgh"
12:13:36.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.972066 15590 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal/instance:
12:13:36.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1562194b6164ee6838699499610e490"
12:13:36.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:36 on dist-test-slave-vcgh"
12:13:36.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.981379 15590 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.000s
12:13:36.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.995355 15614 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:36.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.996711 15590 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.006s	sys 0.004s
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.997092 15590 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1562194b6164ee6838699499610e490"
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:36 on dist-test-slave-vcgh"
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:36.997408 15590 fs_report.cc:389] FS layout report
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data/data
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:36.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:36.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:37.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.072590 15590 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:37.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.074745 15590 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:37.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.075335 15590 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:37.078 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:37.079 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:37.079 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:37.079 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:37.079 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:37.079 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:37.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:37.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:37.080 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:37.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:37.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:37.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:37.080 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:37.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.081178 15590 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:37.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.102888 15590 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:37.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.103174 15590 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:37.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.103463 15590 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:37.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.103665 15590 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:37.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.295326 15590 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.65:40259
12:13:37.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.295495 15726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.65:40259 every 8 connection(s)
12:13:37.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.298100 15590 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/data/info.pb
12:13:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.307878 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15590
12:13:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.308465 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-0/wal/instance
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.319983 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/logs
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data/info.pb
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:37.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.66:0
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.66
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.66
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:37.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:37.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.354048 15727 heartbeater.cc:344] Connected to a master server at 127.14.239.125:46113
12:13:37.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.354563 15727 heartbeater.cc:461] Registering TS with master...
12:13:37.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.355844 15727 heartbeater.cc:507] Master 127.14.239.125:46113 requested a full tablet report, sending...
12:13:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.356709 15728 heartbeater.cc:344] Connected to a master server at 127.14.239.124:41311
12:13:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.357040 15728 heartbeater.cc:461] Registering TS with master...
12:13:37.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.357712 15728 heartbeater.cc:507] Master 127.14.239.124:41311 requested a full tablet report, sending...
12:13:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.359159 15729 heartbeater.cc:344] Connected to a master server at 127.14.239.126:41849
12:13:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.359483 15729 heartbeater.cc:461] Registering TS with master...
12:13:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.360301 15729 heartbeater.cc:507] Master 127.14.239.126:41849 requested a full tablet report, sending...
12:13:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.360476 15494 ts_manager.cc:194] Registered new tserver with Master: d1562194b6164ee6838699499610e490 (127.14.239.65:40259)
12:13:37.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.360576 15414 ts_manager.cc:194] Registered new tserver with Master: d1562194b6164ee6838699499610e490 (127.14.239.65:40259)
12:13:37.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.363027 15338 ts_manager.cc:194] Registered new tserver with Master: d1562194b6164ee6838699499610e490 (127.14.239.65:40259)
12:13:37.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.363188 15494 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.239.65:60365
12:13:37.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512817428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:37.436 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:13:37.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:13:37.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:37.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.638113 15734 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:37.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.638671 15734 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:37.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.639101 15734 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:37.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.671227 15734 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:37.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.672055 15734 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.239.66
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.709797 15734 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.66:0
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data/info.pb
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.66
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.66
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/logs
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:37.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:37.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.711041 15734 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:37.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:37.712622 15734 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:37.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.725060 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:37.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512817928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:37.942 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:37.945 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:13:37.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:38.030 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:38.030 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:38.031 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:38.031 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.031 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.031 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.031 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.031 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.031 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.031 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.031 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.031 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:38.249 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:38.250 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:38.250 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:38.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.251 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.252 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.252 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:38.295 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:38.296 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:38.296 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:38.297 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.297 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.297 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:38.298 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.298 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.298 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:38.298 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.298 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.298 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:38.298 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:38.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:38.366815 15728 heartbeater.cc:499] Master 127.14.239.124:41311 was elected leader, sending a full tablet report...
12:13:38.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512818428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:38.445 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:13:38.447 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:13:38.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:38.930 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512818928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:38.942 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:13:38.943 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:13:38.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:39.159 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:39.160 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:39.160 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:39.160 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:39.160 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:39.160 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:39.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:39.161 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:39.161 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:39.161 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:39.161 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:39.161 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:39.161 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.127681 15743 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 15734
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.229998 15743 kernel_stack_watchdog.cc:198] Thread 15734 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:13:39.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:37.725912 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:39.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.231352 15734 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.506s	user 0.539s	sys 0.925s
12:13:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.231776 15734 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.506s	user 0.539s	sys 0.925s
12:13:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.232349 15734 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.232432 15747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.232892 15746 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1504 milliseconds
12:13:39.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.236204 15734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:39.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.238315 15734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:39.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.239661 15734 hybrid_clock.cc:648] HybridClock initialized: now 1783512819239624 us; error 37 us; skew 500 ppm
12:13:39.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.240459 15734 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:39.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.246451 15734 webserver.cc:533] Webserver started at http://127.14.239.66:43155/ using document root <none> and password file <none>
12:13:39.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.247314 15734 fs_manager.cc:362] Metadata directory not provided
12:13:39.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.247524 15734 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:39.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.247977 15734 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:39.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.252110 15734 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data/instance:
12:13:39.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43760ea1b3c34d7caa7fd0f4835bd553"
12:13:39.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:39 on dist-test-slave-vcgh"
12:13:39.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.253234 15734 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal/instance:
12:13:39.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43760ea1b3c34d7caa7fd0f4835bd553"
12:13:39.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:39 on dist-test-slave-vcgh"
12:13:39.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.259982 15734 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
12:13:39.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.266237 15755 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:39.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.267191 15734 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
12:13:39.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.267511 15734 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal
12:13:39.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "43760ea1b3c34d7caa7fd0f4835bd553"
12:13:39.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:39 on dist-test-slave-vcgh"
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.267817 15734 fs_report.cc:389] FS layout report
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data/data
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:39.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:39.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.315907 15734 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:39.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.317523 15734 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:39.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.318030 15734 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:39.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.320662 15734 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:39.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.324889 15734 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:39.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.325070 15734 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:39.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.325270 15734 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:39.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.325397 15734 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:39.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512819428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:39.437 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:13:39.438 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:13:39.447 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:39.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.460673 15734 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.66:41305
12:13:39.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.460800 15867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.66:41305 every 8 connection(s)
12:13:39.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.463035 15734 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/data/info.pb
12:13:39.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.470970 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15734
12:13:39.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.471395 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-1/wal/instance
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.487363 15293 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/logs
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data/info.pb
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:39.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.67:0
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.67
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.67
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:39.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.499090 15869 heartbeater.cc:344] Connected to a master server at 127.14.239.124:41311
12:13:39.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.499617 15869 heartbeater.cc:461] Registering TS with master...
12:13:39.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.501042 15869 heartbeater.cc:507] Master 127.14.239.124:41311 requested a full tablet report, sending...
12:13:39.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.503944 15494 ts_manager.cc:194] Registered new tserver with Master: 43760ea1b3c34d7caa7fd0f4835bd553 (127.14.239.66:41305)
12:13:39.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.505872 15494 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.239.66:50259
12:13:39.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.509370 15868 heartbeater.cc:344] Connected to a master server at 127.14.239.125:46113
12:13:39.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.509706 15868 heartbeater.cc:461] Registering TS with master...
12:13:39.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.510342 15868 heartbeater.cc:507] Master 127.14.239.125:46113 requested a full tablet report, sending...
12:13:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.513057 15414 ts_manager.cc:194] Registered new tserver with Master: 43760ea1b3c34d7caa7fd0f4835bd553 (127.14.239.66:41305)
12:13:39.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.515656 15870 heartbeater.cc:344] Connected to a master server at 127.14.239.126:41849
12:13:39.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.515909 15870 heartbeater.cc:461] Registering TS with master...
12:13:39.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.516366 15870 heartbeater.cc:507] Master 127.14.239.126:41849 requested a full tablet report, sending...
12:13:39.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.518525 15338 ts_manager.cc:194] Registered new tserver with Master: 43760ea1b3c34d7caa7fd0f4835bd553 (127.14.239.66:41305)
12:13:39.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.799817 15878 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:39.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.800326 15878 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:39.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.800877 15878 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:39.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.832827 15878 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:39.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.833686 15878 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.239.67
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.869391 15878 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.14.239.84:36225
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal
12:13:39.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.14.239.67:0
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data/info.pb
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.14.239.67
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.14.239.126:41849,127.14.239.125:46113,127.14.239.124:41311
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.14.239.67
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/logs
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:39.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:39.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.870939 15878 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:39.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:39.872511 15878 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:39.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.884435 15884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:39.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512819928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:39.939 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:39.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:13:39.947 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:40.333 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:40.334 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:40.334 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:40.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.335 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.335 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.336 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.336 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:40.409 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:40.409 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:40.410 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:40.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:40.410 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:40.410 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.410 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:40.410 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:40.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512820427 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:40.437 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:40.438 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:13:40.448 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:40.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:40.510052 15869 heartbeater.cc:499] Master 127.14.239.124:41311 was elected leader, sending a full tablet report...
12:13:40.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512820928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:40.937 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:13:40.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:13:40.940 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:40.941 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:40.941 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:40.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.943 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:40.943 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28575), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [178ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [178ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [304ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [665ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [672ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [673ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [725ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1366ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1367ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3025ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@1700687296(state=PENDING, result=null, callback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547), errback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547)))
12:13:40.944 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:40.945 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:40.945 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.945 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.945 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.945 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:40.945 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.945 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.946 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:40.946 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28575), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [178ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [178ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [304ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [665ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [672ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [673ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [725ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1366ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1367ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3025ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@1700687296(state=PENDING, result=null, callback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547), errback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28575), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [178ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [178ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [304ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [665ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [672ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [673ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [725ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1366ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1367ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3025ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@1700687296(state=PENDING, result=null, callback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547), errback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:40.951 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28575), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [178ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [178ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [304ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [665ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [672ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [673ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [725ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1366ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1367ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3025ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@1700687296(state=PENDING, result=null, callback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547), errback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28575), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [65ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [158ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [178ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [178ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [208ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [215ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [217ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [304ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [304ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [665ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [672ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [673ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [725ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1361ms] refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1366ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1367ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3024ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3025ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5941ms] refreshing cache from master, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5942ms] too many traces: truncated at 100 traces, deferred=Deferred@1700687296(state=PENDING, result=null, callback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547), errback=(continuation of Deferred@837754839 after retry RPC after error@1732810973) -> (continuation of Deferred@1793349918 after retry RPC after error@2084706799) -> (continuation of Deferred@890937367 after retry RPC after error@381114393) -> (continuation of Deferred@1582555000 after retry RPC after error@850536508) -> (continuation of Deferred@1380465765 after retry RPC after error@2123616677) -> (continuation of Deferred@1048279312 after retry RPC after error@497767723) -> (continuation of Deferred@236190191 after retry RPC after error@1852641137) -> (continuation of Deferred@196827221 after retry RPC after error@1283343876) -> (continuation of Deferred@1572016869 after retry RPC after error@1529055397) -> (continuation of Deferred@168499812 after retry RPC after error@888873799) -> (continuation of Deferred@1897544455 after retry RPC after error@918283041) -> (continuation of Deferred@1689323432 after retry RPC after error@163438946) -> (continuation of Deferred@694100305 after retry RPC after error@1075080624) -> (continuation of Deferred@754237021 after retry RPC after error@1252322384) -> (continuation of Deferred@438376956 after retry RPC after error@2033950437) -> (continuation of Deferred@1882509769 after retry RPC after error@496985587) -> (continuation of Deferred@266559813 after retry RPC after error@705305322) -> (continuation of Deferred@2095463675 after retry RPC after error@439385705) -> (continuation of Deferred@248372515 after retry RPC after error@1953123162) -> (continuation of Deferred@958832840 after retry RPC after error@545018547)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:40.952 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:13:40.952 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:13:40.953 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
12:13:40.953 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
12:13:40.953 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:13:40.953 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
12:13:40.953 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:13:40.954 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
12:13:40.954 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:13:40.956 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:13:40.956 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
12:13:40.956 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
12:13:40.956 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:13:40.961 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:40.961 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:40.961 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:40.961 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:40.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.962 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:40.965 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:13:40.965 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:13:40.966 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:13:40.966 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:13:40.966 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
12:13:40.966 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:13:40.967 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:13:40.967 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:13:40.967 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:13:40.967 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:13:40.967 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:13:40.967 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:13:40.968 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:13:40.968 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:13:40.968 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:13:40.969 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:13:40.969 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:13:40.969 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:13:40.970 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:13:40.971 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
12:13:40.971 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:13:40.971 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
12:13:40.972 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:13:40.973 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:13:40.973 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:13:40.973 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:13:40.973 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:13:40.973 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:40.974 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:13:40.974 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:40.974 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:13:40.974 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:40.974 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:13:40.981 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:40.981 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:40.981 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:40.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:40.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:40.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:40.982 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.001 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.001 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.002 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.002 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.002 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.003 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.003 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.020 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.021 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.021 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.022 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.061 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.061 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.061 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.062 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.062 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.062 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.062 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.062 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.063 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:39.885341 15885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:41.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:41.067081 15887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:41.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:41.070150 15886 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1179 milliseconds
12:13:41.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.070290 15878 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:41.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.071447 15878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:41.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.073516 15878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:41.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.074852 15878 hybrid_clock.cc:648] HybridClock initialized: now 1783512821074819 us; error 31 us; skew 500 ppm
12:13:41.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.075646 15878 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:41.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.081223 15878 webserver.cc:533] Webserver started at http://127.14.239.67:38199/ using document root <none> and password file <none>
12:13:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.082072 15878 fs_manager.cc:362] Metadata directory not provided
12:13:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.082279 15878 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.082765 15878 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:41.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.086932 15878 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data/instance:
12:13:41.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a3c1273c788468592a8a705dc7962d6"
12:13:41.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:41 on dist-test-slave-vcgh"
12:13:41.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.088021 15878 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal/instance:
12:13:41.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a3c1273c788468592a8a705dc7962d6"
12:13:41.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:41 on dist-test-slave-vcgh"
12:13:41.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.095099 15878 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.002s
12:13:41.100 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.101 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.100948 15906 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:41.101 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.102 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.102 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.102283 15878 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:13:41.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.102589 15878 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal
12:13:41.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a3c1273c788468592a8a705dc7962d6"
12:13:41.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:41 on dist-test-slave-vcgh"
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.102937 15878 fs_report.cc:389] FS layout report
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data/data
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:41.120 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.121 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.121 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.122 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.153594 15878 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:41.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.155051 15878 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:41.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.155511 15878 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:41.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.158039 15878 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:41.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.162106 15878 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:41.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.162312 15878 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:41.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.162592 15878 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:41.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.162753 15878 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:41.200 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.201 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.201 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.201 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.201 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.201 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.201 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.201 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.202 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.202 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.202 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.202 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.202 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.296654 15878 rpc_server.cc:307] RPC server started. Bound to: 127.14.239.67:39483
12:13:41.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.298022 16019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.239.67:39483 every 8 connection(s)
12:13:41.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.299674 15878 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/data/info.pb
12:13:41.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.301702 15293 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 15878
12:13:41.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.302129 15293 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster4099248399410787601/ts-2/wal/instance
12:13:41.330 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:41.331 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:41.331 [DEBUG - pool-38-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:41.331 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.331 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.331 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.331 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.332 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.332 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.332 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:41.333 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=21, TimeoutTracker(timeout=30000, elapsed=28904), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [137ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [138ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [210ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [212ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [214ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [216ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [216ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [244ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [244ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [284ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [285ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [285ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [285ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [323ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [323ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [427ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [427ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [427ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [564ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [821ms] refreshing cache from master, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [823ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [824ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [824ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2461ms] refreshing cache from master, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2463ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2468ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2469ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [5800ms] refreshing cache from master, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5802ms] too many traces: truncated at 100 traces, deferred=Deferred@166363800(state=PENDING, result=null, callback=(continuation of Deferred@251390956 after retry RPC after error@1902723286) -> (continuation of Deferred@10918354 after retry RPC after error@1569010972) -> (continuation of Deferred@217059787 after retry RPC after error@925146995) -> (continuation of Deferred@66648140 after retry RPC after error@2007044346) -> (continuation of Deferred@2077440396 after retry RPC after error@1746927234) -> (continuation of Deferred@744571221 after retry RPC after error@1404613347) -> (continuation of Deferred@835059265 after retry RPC after error@641334549) -> (continuation of Deferred@16022382 after retry RPC after error@374206009) -> (continuation of Deferred@140782919 after retry RPC after error@1633462283) -> (continuation of Deferred@1112576069 after retry RPC after error@991269392) -> (continuation of Deferred@305307168 after retry RPC after error@371875997) -> (continuation of Deferred@1354635429 after retry RPC after error@1194104240) -> (continuation of Deferred@1105842411 after retry RPC after error@67268291) -> (continuation of Deferred@609822166 after retry RPC after error@125548024) -> (continuation of Deferred@144327540 after retry RPC after error@536428754) -> (continuation of Deferred@1919132014 after retry RPC after error@686628527) -> (continuation of Deferred@1924557093 after retry RPC after error@664553585) -> (continuation of Deferred@1209787709 after retry RPC after error@147034871) -> (continuation of Deferred@1241333131 after retry RPC after error@208087813) -> (continuation of Deferred@465704377 after retry RPC after error@251820060), errback=(continuation of Deferred@251390956 after retry RPC after error@1902723286) -> (continuation of Deferred@10918354 after retry RPC after error@1569010972) -> (continuation of Deferred@217059787 after retry RPC after error@925146995) -> (continuation of Deferred@66648140 after retry RPC after error@2007044346) -> (continuation of Deferred@2077440396 after retry RPC after error@1746927234) -> (continuation of Deferred@744571221 after retry RPC after error@1404613347) -> (continuation of Deferred@835059265 after retry RPC after error@641334549) -> (continuation of Deferred@16022382 after retry RPC after error@374206009) -> (continuation of Deferred@140782919 after retry RPC after error@1633462283) -> (continuation of Deferred@1112576069 after retry RPC after error@991269392) -> (continuation of Deferred@305307168 after retry RPC after error@371875997) -> (continuation of Deferred@1354635429 after retry RPC after error@1194104240) -> (continuation of Deferred@1105842411 after retry RPC after error@67268291) -> (continuation of Deferred@609822166 after retry RPC after error@125548024) -> (continuation of Deferred@144327540 after retry RPC after error@536428754) -> (continuation of Deferred@1919132014 after retry RPC after error@686628527) -> (continuation of Deferred@1924557093 after retry RPC after error@664553585) -> (continuation of Deferred@1209787709 after retry RPC after error@147034871) -> (continuation of Deferred@1241333131 after retry RPC after error@208087813) -> (continuation of Deferred@465704377 after retry RPC after error@251820060)))
12:13:41.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.349550 16020 heartbeater.cc:344] Connected to a master server at 127.14.239.125:46113
12:13:41.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.350003 16020 heartbeater.cc:461] Registering TS with master...
12:13:41.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.351328 16020 heartbeater.cc:507] Master 127.14.239.125:46113 requested a full tablet report, sending...
12:13:41.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.354261 15414 ts_manager.cc:194] Registered new tserver with Master: 6a3c1273c788468592a8a705dc7962d6 (127.14.239.67:39483)
12:13:41.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.354295 16021 heartbeater.cc:344] Connected to a master server at 127.14.239.124:41311
12:13:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.354676 16021 heartbeater.cc:461] Registering TS with master...
12:13:41.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.355690 16021 heartbeater.cc:507] Master 127.14.239.124:41311 requested a full tablet report, sending...
12:13:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.356400 16024 heartbeater.cc:344] Connected to a master server at 127.14.239.126:41849
12:13:41.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.356738 16024 heartbeater.cc:461] Registering TS with master...
12:13:41.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.357400 16024 heartbeater.cc:507] Master 127.14.239.126:41849 requested a full tablet report, sending...
12:13:41.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.357896 15494 ts_manager.cc:194] Registered new tserver with Master: 6a3c1273c788468592a8a705dc7962d6 (127.14.239.67:39483)
12:13:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.359635 15338 ts_manager.cc:194] Registered new tserver with Master: 6a3c1273c788468592a8a705dc7962d6 (127.14.239.67:39483)
12:13:41.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.359758 15494 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.239.67:53007
12:13:41.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.370985 15293 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:13:41.381 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:13:41.381 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:13:41.382 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.239.126"
      port: 41849
    }
    bound_http_address {
      host: "127.14.239.126"
      port: 34417
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.239.125"
      port: 46113
    }
    bound_http_address {
      host: "127.14.239.125"
      port: 46803
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.239.124"
      port: 41311
    }
    bound_http_address {
      host: "127.14.239.124"
      port: 35653
    }
  }
}

12:13:41.383 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:13:41.383 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.14.239.65"
      port: 40259
    }
    bound_http_address {
      host: "127.14.239.65"
      port: 39389
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.14.239.66"
      port: 41305
    }
    bound_http_address {
      host: "127.14.239.66"
      port: 43155
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.14.239.67"
      port: 39483
    }
    bound_http_address {
      host: "127.14.239.67"
      port: 38199
    }
  }
}

12:13:41.384 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:13:41.386 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:41.386 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:13:41.386 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:13:41.386 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:13:41.387 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:13:41.390 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:13:41.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512821428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:41.435 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:13:41.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:13:41.489 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:41.489 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:41.490 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:41.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.490 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.491 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:41.520 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:41.521 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:41.521 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:41.521 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.521 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.521 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:41.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:41.522 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.522 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.522 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:41.522 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:41.675 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:41.676 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:41.676 [DEBUG - pool-34-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:41.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.676 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.676 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.676 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.677 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.677 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:41.678 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29243), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [93ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [94ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [97ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [97ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [153ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [160ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [172ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [220ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [244ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [244ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [251ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [252ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [264ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [463ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [465ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [701ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [704ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [704ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1165ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1165ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2041ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2042ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2043ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2044ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2046ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2046ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2320ms] refreshing cache from master, [2320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2323ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2425ms] refreshing cache from master, [2426ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2429ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2430ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2430ms] too many traces: truncated at 100 traces, deferred=Deferred@426688125(state=PENDING, result=null, callback=(continuation of Deferred@415344991 after retry RPC after error@1583185633) -> (continuation of Deferred@1080650753 after retry RPC after error@739819303) -> (continuation of Deferred@956719274 after retry RPC after error@203008797) -> (continuation of Deferred@127649787 after retry RPC after error@1855173032) -> (continuation of Deferred@1679462368 after retry RPC after error@630886717) -> (continuation of Deferred@2087136874 after retry RPC after error@260755135) -> (continuation of Deferred@1071592737 after retry RPC after error@1312639134) -> (continuation of Deferred@191638349 after retry RPC after error@1380639657) -> (continuation of Deferred@343585532 after retry RPC after error@816275797) -> (continuation of Deferred@1526403663 after retry RPC after error@1596581138) -> (continuation of Deferred@512049497 after retry RPC after error@354629141) -> (continuation of Deferred@398993300 after retry RPC after error@123293962) -> (continuation of Deferred@862078769 after retry RPC after error@1065176278) -> (continuation of Deferred@1776232490 after retry RPC after error@608429338) -> (continuation of Deferred@87647596 after retry RPC after error@1350013665) -> (continuation of Deferred@1090088637 after retry RPC after error@2066294925) -> (continuation of Deferred@896872577 after retry RPC after error@1509510228) -> (continuation of Deferred@1384009040 after retry RPC after error@1612802770) -> (continuation of Deferred@2085400431 after retry RPC after error@1866778462) -> (continuation of Deferred@1341133611 after retry RPC after error@619481085) -> (continuation of Deferred@1027765208 after retry RPC after error@1953840409) -> (continuation of Deferred@995299831 after retry RPC after error@2067835407) -> (continuation of Deferred@1437784588 after retry RPC after error@150120534), errback=(continuation of Deferred@415344991 after retry RPC after error@1583185633) -> (continuation of Deferred@1080650753 after retry RPC after error@739819303) -> (continuation of Deferred@956719274 after retry RPC after error@203008797) -> (continuation of Deferred@127649787 after retry RPC after error@1855173032) -> (continuation of Deferred@1679462368 after retry RPC after error@630886717) -> (continuation of Deferred@2087136874 after retry RPC after error@260755135) -> (continuation of Deferred@1071592737 after retry RPC after error@1312639134) -> (continuation of Deferred@191638349 after retry RPC after error@1380639657) -> (continuation of Deferred@343585532 after retry RPC after error@816275797) -> (continuation of Deferred@1526403663 after retry RPC after error@1596581138) -> (continuation of Deferred@512049497 after retry RPC after error@354629141) -> (continuation of Deferred@398993300 after retry RPC after error@123293962) -> (continuation of Deferred@862078769 after retry RPC after error@1065176278) -> (continuation of Deferred@1776232490 after retry RPC after error@608429338) -> (continuation of Deferred@87647596 after retry RPC after error@1350013665) -> (continuation of Deferred@1090088637 after retry RPC after error@2066294925) -> (continuation of Deferred@896872577 after retry RPC after error@1509510228) -> (continuation of Deferred@1384009040 after retry RPC after error@1612802770) -> (continuation of Deferred@2085400431 after retry RPC after error@1866778462) -> (continuation of Deferred@1341133611 after retry RPC after error@619481085) -> (continuation of Deferred@1027765208 after retry RPC after error@1953840409) -> (continuation of Deferred@995299831 after retry RPC after error@2067835407) -> (continuation of Deferred@1437784588 after retry RPC after error@150120534)))
12:13:41.732 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:13:41.732 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:13:41.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.735555 16030 mini_oidc.cc:150] Starting JWKS server
12:13:41.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.738704 16030 webserver.cc:533] Webserver started at http://127.0.0.1:34047/ using document root <none> and password file <none>
12:13:41.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.739133 16030 mini_oidc.cc:186] Starting OIDC Discovery server
12:13:41.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.741127 16030 webserver.cc:533] Webserver started at http://127.0.0.1:38209/ using document root <none> and password file <none>
12:13:41.749 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:41.749 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:41.750 [DEBUG - pool-36-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:41.750 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.750 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.750 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.750 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.750 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.751 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.751 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:41.752 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29334), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [149ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [184ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [215ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [218ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [219ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [249ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [256ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [284ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [285ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [303ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [303ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [327ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [327ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [344ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [346ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [346ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [484ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [484ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [704ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [704ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1022ms] refreshing cache from master, [1022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1023ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1024ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1029ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1029ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1029ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1861ms] refreshing cache from master, [1861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1862ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1863ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1864ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1864ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2380ms] refreshing cache from master, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2561ms] refreshing cache from master, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2563ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2563ms] too many traces: truncated at 100 traces, deferred=Deferred@720035954(state=PENDING, result=null, callback=(continuation of Deferred@849524397 after retry RPC after error@1901653545) -> (continuation of Deferred@1118805169 after retry RPC after error@1069223398) -> (continuation of Deferred@411816802 after retry RPC after error@781471740) -> (continuation of Deferred@283116683 after retry RPC after error@2001993548) -> (continuation of Deferred@830812679 after retry RPC after error@1029861476) -> (continuation of Deferred@758574879 after retry RPC after error@1173867626) -> (continuation of Deferred@1576717273 after retry RPC after error@1932878162) -> (continuation of Deferred@1767974460 after retry RPC after error@311309286) -> (continuation of Deferred@421627501 after retry RPC after error@1095130090) -> (continuation of Deferred@569824568 after retry RPC after error@1107608547) -> (continuation of Deferred@1468213024 after retry RPC after error@619298609) -> (continuation of Deferred@857858433 after retry RPC after error@1474176989) -> (continuation of Deferred@422223905 after retry RPC after error@1892914178) -> (continuation of Deferred@1287806576 after retry RPC after error@1778678010) -> (continuation of Deferred@652473907 after retry RPC after error@1249645929) -> (continuation of Deferred@336851848 after retry RPC after error@1570347608) -> (continuation of Deferred@1685237174 after retry RPC after error@1309621004) -> (continuation of Deferred@1158352630 after retry RPC after error@1422985045) -> (continuation of Deferred@633278308 after retry RPC after error@308250500) -> (continuation of Deferred@264128391 after retry RPC after error@1401492106) -> (continuation of Deferred@244380592 after retry RPC after error@1612523073) -> (continuation of Deferred@501405626 after retry RPC after error@115641294) -> (continuation of Deferred@266401233 after retry RPC after error@105313602) -> (continuation of Deferred@219331895 after retry RPC after error@797633952) -> (continuation of Deferred@667732989 after retry RPC after error@378656419) -> (continuation of Deferred@242362947 after retry RPC after error@1986863552) -> (continuation of Deferred@926912467 after retry RPC after error@797139801), errback=(continuation of Deferred@849524397 after retry RPC after error@1901653545) -> (continuation of Deferred@1118805169 after retry RPC after error@1069223398) -> (continuation of Deferred@411816802 after retry RPC after error@781471740) -> (continuation of Deferred@283116683 after retry RPC after error@2001993548) -> (continuation of Deferred@830812679 after retry RPC after error@1029861476) -> (continuation of Deferred@758574879 after retry RPC after error@1173867626) -> (continuation of Deferred@1576717273 after retry RPC after error@1932878162) -> (continuation of Deferred@1767974460 after retry RPC after error@311309286) -> (continuation of Deferred@421627501 after retry RPC after error@1095130090) -> (continuation of Deferred@569824568 after retry RPC after error@1107608547) -> (continuation of Deferred@1468213024 after retry RPC after error@619298609) -> (continuation of Deferred@857858433 after retry RPC after error@1474176989) -> (continuation of Deferred@422223905 after retry RPC after error@1892914178) -> (continuation of Deferred@1287806576 after retry RPC after error@1778678010) -> (continuation of Deferred@652473907 after retry RPC after error@1249645929) -> (continuation of Deferred@336851848 after retry RPC after error@1570347608) -> (continuation of Deferred@1685237174 after retry RPC after error@1309621004) -> (continuation of Deferred@1158352630 after retry RPC after error@1422985045) -> (continuation of Deferred@633278308 after retry RPC after error@308250500) -> (continuation of Deferred@264128391 after retry RPC after error@1401492106) -> (continuation of Deferred@244380592 after retry RPC after error@1612523073) -> (continuation of Deferred@501405626 after retry RPC after error@115641294) -> (continuation of Deferred@266401233 after retry RPC after error@105313602) -> (continuation of Deferred@219331895 after retry RPC after error@797633952) -> (continuation of Deferred@667732989 after retry RPC after error@378656419) -> (continuation of Deferred@242362947 after retry RPC after error@1986863552) -> (continuation of Deferred@926912467 after retry RPC after error@797139801)))
12:13:41.774 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:41.775 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:41.775 [DEBUG - pool-40-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:41.775 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:41.775 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.775 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:41.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:41.776 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:41.777 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29343), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [114ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [177ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [185ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [189ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [189ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [284ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [444ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [444ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [444ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [504ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [504ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [624ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1660ms] refreshing cache from master, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1663ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1665ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1665ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2122ms] too many traces: truncated at 100 traces, deferred=Deferred@1106031716(state=PENDING, result=null, callback=(continuation of Deferred@595328996 after retry RPC after error@1817363277) -> (continuation of Deferred@202890249 after retry RPC after error@679220859) -> (continuation of Deferred@1417959503 after retry RPC after error@783720761) -> (continuation of Deferred@477353842 after retry RPC after error@1425327433) -> (continuation of Deferred@574929336 after retry RPC after error@971008928) -> (continuation of Deferred@992666537 after retry RPC after error@1233565448) -> (continuation of Deferred@1309167353 after retry RPC after error@1955566067) -> (continuation of Deferred@416547680 after retry RPC after error@1687603589) -> (continuation of Deferred@1759853672 after retry RPC after error@1626159246) -> (continuation of Deferred@1486551280 after retry RPC after error@177395847) -> (continuation of Deferred@1272292289 after retry RPC after error@1123404669) -> (continuation of Deferred@1302849195 after retry RPC after error@1366120824) -> (continuation of Deferred@926950207 after retry RPC after error@1526900873) -> (continuation of Deferred@702717948 after retry RPC after error@318747937) -> (continuation of Deferred@613430682 after retry RPC after error@1779996513) -> (continuation of Deferred@1471735969 after retry RPC after error@939592138) -> (continuation of Deferred@496551861 after retry RPC after error@857078008) -> (continuation of Deferred@595125211 after retry RPC after error@327672103) -> (continuation of Deferred@1224288653 after retry RPC after error@1421335122) -> (continuation of Deferred@817204516 after retry RPC after error@471325900) -> (continuation of Deferred@497232770 after retry RPC after error@1999374126) -> (continuation of Deferred@1802266690 after retry RPC after error@1228875871) -> (continuation of Deferred@1304753601 after retry RPC after error@1514573344) -> (continuation of Deferred@1382077266 after retry RPC after error@1647146129), errback=(continuation of Deferred@595328996 after retry RPC after error@1817363277) -> (continuation of Deferred@202890249 after retry RPC after error@679220859) -> (continuation of Deferred@1417959503 after retry RPC after error@783720761) -> (continuation of Deferred@477353842 after retry RPC after error@1425327433) -> (continuation of Deferred@574929336 after retry RPC after error@971008928) -> (continuation of Deferred@992666537 after retry RPC after error@1233565448) -> (continuation of Deferred@1309167353 after retry RPC after error@1955566067) -> (continuation of Deferred@416547680 after retry RPC after error@1687603589) -> (continuation of Deferred@1759853672 after retry RPC after error@1626159246) -> (continuation of Deferred@1486551280 after retry RPC after error@177395847) -> (continuation of Deferred@1272292289 after retry RPC after error@1123404669) -> (continuation of Deferred@1302849195 after retry RPC after error@1366120824) -> (continuation of Deferred@926950207 after retry RPC after error@1526900873) -> (continuation of Deferred@702717948 after retry RPC after error@318747937) -> (continuation of Deferred@613430682 after retry RPC after error@1779996513) -> (continuation of Deferred@1471735969 after retry RPC after error@939592138) -> (continuation of Deferred@496551861 after retry RPC after error@857078008) -> (continuation of Deferred@595125211 after retry RPC after error@327672103) -> (continuation of Deferred@1224288653 after retry RPC after error@1421335122) -> (continuation of Deferred@817204516 after retry RPC after error@471325900) -> (continuation of Deferred@497232770 after retry RPC after error@1999374126) -> (continuation of Deferred@1802266690 after retry RPC after error@1228875871) -> (continuation of Deferred@1304753601 after retry RPC after error@1514573344) -> (continuation of Deferred@1382077266 after retry RPC after error@1647146129)))
12:13:41.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:13:41.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:13:41Z Disabled control of system clock
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:41.797343 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/logs
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data/info.pb
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:41.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.190:46157
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.190
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:41.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json with env {}
12:13:41.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512821928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:41.936 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:13:41.937 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:13:42.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.087564 16042 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:42.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.088160 16042 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:42.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.088600 16042 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:42.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.121642 16042 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.121914 16042 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.122102 16042 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.122308 16042 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.122501 16042 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:42.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.122648 16042 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34047/jwks.json
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:42.159651 16042 master_runner.cc:387] Master server non-default flags:
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.190:46157
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data/info.pb
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.190
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/logs
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:42.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:42.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:42.160936 16042 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:42.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:42.162405 16042 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:42.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.173128 16048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:42.341 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.341 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.342 [DEBUG - pool-32-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.343 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.343 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:42.363090 16021 heartbeater.cc:499] Master 127.14.239.124:41311 was elected leader, sending a full tablet report...
12:13:42.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512822428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:42.443 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
12:13:42.445 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:13:42.543 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:13:42.544 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:13:42.545 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
12:13:42.545 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:13:42.546 [INFO - Thread-19] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:13:42.546 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
12:13:42.546 [DEBUG - Thread-19] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:13:42.547 [DEBUG - Thread-19] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:13:42.547 [DEBUG - Thread-19] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:13:42.547 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:42.547 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:42.549 [INFO - Thread-19] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:13:42.549 [INFO - Thread-19] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:13:42.552 [DEBUG - Thread-19] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:42.553 [INFO - Thread-19] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:13:42.554 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
12:13:42.554 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:13:42.554 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
12:13:42.554 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:13:42.556 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:13:42.558 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:42.559 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
12:13:42.559 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:13:42.559 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
12:13:42.560 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:42.560 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
12:13:42.560 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:13:42.560 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
12:13:42.561 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:13:42.562 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
12:13:42.562 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:13:42.563 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:42.563 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:42.563 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:42.563 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:42.564 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:13:42.565 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:13:42.566 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
12:13:42.566 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
12:13:42.567 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@18c40780
12:13:42.567 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:42.567 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:42.568 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:13:42.568 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:13:42.573 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:13:42.574 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:13:42.574 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
12:13:42.574 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
12:13:42.575 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@24ca10e3
12:13:42.575 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e5546a
12:13:42.575 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:42.575 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:42.576 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:13:42.576 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:13:42.579 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:42.580 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:13:42.581 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:13:42.582 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ec77f98
12:13:42.583 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
12:13:42.583 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
12:13:42.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5515c288
12:13:42.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:42.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:42.584 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:13:42.585 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:13:42.586 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:42.597 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2aa17d62
12:13:42.600 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:42.602 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.604 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
12:13:42.604 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
12:13:42.605 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f918e4a
12:13:42.606 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:42.606 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:13:42.606 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:13:42.606 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:13:42.607 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.613 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5ea6d44c
12:13:42.614 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.629 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:42.630 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.631 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.634 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.634 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.634 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.635 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.636 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.636 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.636 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.636 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:42.643 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.644 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.644 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.644 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.645 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.648 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.648 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.649 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.650 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.651 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.653 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.656 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.658 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.659 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.659 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.659 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.660 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.661 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.663 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.663 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.663 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.663 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.663 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.664 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.664 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.665 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.667 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.667 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.667 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.669 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.670 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.673 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.675 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.675 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.676 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.676 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.676 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.676 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.676 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.676 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.677 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.677 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.679 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.679 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.679 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.679 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.680 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.680 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.681 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.681 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.682 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.683 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.686 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.686 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.687 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.689 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.689 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.690 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.690 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.690 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.690 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.691 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.691 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.691 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.691 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.692 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.692 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.692 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.693 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.694 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.694 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.694 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.695 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.696 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.697 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.698 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.699 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.699 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.699 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.700 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.701 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.701 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.701 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.701 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.701 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.703 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.704 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.705 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.705 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.706 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.706 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.706 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.706 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.707 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.707 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.707 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.707 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.707 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.708 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.709 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.709 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.709 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.709 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.710 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.710 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.710 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.711 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.712 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.714 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.715 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.715 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.716 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.716 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.716 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.716 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.716 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.716 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.717 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.717 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.717 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.717 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.718 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.723 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.723 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.723 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.723 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.723 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.723 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.724 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.724 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.724 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.724 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.724 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.731 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.731 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.731 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.731 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.731 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.732 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.732 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.732 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.733 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.734 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.735 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.735 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.735 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.735 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.735 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.736 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.736 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.736 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.736 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.736 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.736 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.736 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.737 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.737 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.737 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.739 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.739 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.739 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.739 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.743 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.743 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.743 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.744 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.744 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.744 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.744 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.744 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.744 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.745 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.745 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.748 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.748 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.748 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.748 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.748 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.748 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.749 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.749 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.749 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.749 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.749 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.749 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.749 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.750 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.751 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.751 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.751 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.751 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.751 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.751 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.751 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.751 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.751 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.751 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.751 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.752 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.754 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.754 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.755 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.756 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.756 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.756 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.756 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.757 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.757 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.757 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.757 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.757 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.758 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.758 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.758 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.758 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.763 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.763 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.764 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.764 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.764 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.764 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.767 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.768 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.768 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.771 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.771 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.771 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.772 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.772 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.773 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.773 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.774 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.774 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.774 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.774 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.787 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.788 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.788 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.789 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.789 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.789 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.789 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.789 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.789 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.789 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.796 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.796 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.797 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.797 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.797 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.797 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.797 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.797 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.810 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.811 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.811 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.812 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.812 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.812 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.812 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.812 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.813 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.836 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.836 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.837 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.837 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.837 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.839 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.839 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.839 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.843 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.843 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.843 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.844 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.844 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.844 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.844 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.844 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.844 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.845 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.848 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.848 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.849 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.849 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.849 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.849 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.850 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.851 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.851 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.851 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.851 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.851 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.851 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.852 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.852 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.852 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.852 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.894 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.896 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.897 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.897 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.897 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.897 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.898 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.923 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.924 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.924 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.926 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512822928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:42.938 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:13:42.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:13:42.939 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:42.940 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:42.940 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:42.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:42.941 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:42.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:42.941 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:42.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:42.941 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:42.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:42.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:42.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:42.941 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:42.955 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:42.955 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:42.956 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:42.956 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.956 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.956 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:42.956 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.956 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.956 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:42.957 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.957 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.957 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:42.957 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:42.976 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.976 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.977 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.977 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.977 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.977 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.978 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.978 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.978 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.978 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.978 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.978 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.978 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:42.987 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:42.987 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:42.988 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:42.988 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:42.989 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.989 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.989 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:42.991 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.991 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:42.991 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.007 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.008 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.008 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.009 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.009 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.009 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.009 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.010 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.031 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.031 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.031 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.032 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.032 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.032 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.032 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.032 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.083 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.084 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.084 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.085 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.085 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.085 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.085 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:43.203 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.204 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.205 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.206 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.206 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.206 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.206 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.308 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.308 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.309 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.311 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.377 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.377 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.378 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.378 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.378 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.378 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.378 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.378 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.378 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.378 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.378 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.378 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.379 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.176594 16051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:43.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:42.174183 16049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:43.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.394924 16050 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1216 milliseconds
12:13:43.395 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:43.395 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:43.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.395226 16042 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:43.395 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:43.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:43.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:43.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:43.397 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:43.397 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:43.397 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:43.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.396956 16042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:43.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.400132 16042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:43.401 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:43.401 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:43.401 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:43.401 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:43.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.401669 16042 hybrid_clock.cc:648] HybridClock initialized: now 1783512823401624 us; error 24 us; skew 500 ppm
12:13:43.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.402830 16042 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:43.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.410100 16042 webserver.cc:533] Webserver started at http://127.15.167.190:35943/ using document root <none> and password file <none>
12:13:43.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.411286 16042 fs_manager.cc:362] Metadata directory not provided
12:13:43.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.411571 16042 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:43.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.412155 16042 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:43.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.418264 16042 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data/instance:
12:13:43.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "90f43a189de44d36b3d53517ba62a41b"
12:13:43.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:43 on dist-test-slave-vcgh"
12:13:43.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.419721 16042 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal/instance:
12:13:43.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "90f43a189de44d36b3d53517ba62a41b"
12:13:43.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:43 on dist-test-slave-vcgh"
12:13:43.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.427414 16042 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
12:13:43.428 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.428 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.428 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.429 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.429 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.429 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.429 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512823428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:43.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.433801 16113 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.434844 16042 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.435148 16042 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "90f43a189de44d36b3d53517ba62a41b"
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:43 on dist-test-slave-vcgh"
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.435449 16042 fs_report.cc:389] FS layout report
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data/data
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:43.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:43.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:43.437 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:13:43.437 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:13:43.450 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.451 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.451 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.451 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.452 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.452 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.452 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.452 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.452 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.452 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.487598 16042 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.489019 16042 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.489421 16042 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:43.517 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.517 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.517 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.518 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.518 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.518 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.518 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.518 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.518 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.518 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.518 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.518 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.518 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.543 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.543 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.544 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.545 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.545 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.545 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.545 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.545 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.561198 16042 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.190:46157
12:13:43.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.561297 16164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.190:46157 every 8 connection(s)
12:13:43.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.563868 16042 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/data/info.pb
12:13:43.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.565867 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16042
12:13:43.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.566358 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-0/wal/instance
12:13:43.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.571643 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/logs
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data/info.pb
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.189:34023
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.189
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json with env {}
12:13:43.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.571862 16165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:43.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.583118 16165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } has no permanent_uuid. Determining permanent_uuid...
12:13:43.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.607319 16165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } has no permanent_uuid. Determining permanent_uuid...
12:13:43.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.609683 16117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:43.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.613687 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:43.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:43.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.663090 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 1
12:13:43.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.667110 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:43.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.735551 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 2
12:13:43.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.739917 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:43.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.764 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.764 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.765 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.765 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.765 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.765 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.765 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.787 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.788 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.788 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.788 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.789 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.789 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.823 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.823 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.824 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.824 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.824 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.824 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.824 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.825 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.831348 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 3
12:13:43.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.836119 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:43.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.877389 16167 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:43.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.877966 16167 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:43.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.878459 16167 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.910846 16167 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.911109 16167 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.911316 16167 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.911510 16167 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.911695 16167 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:43.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.911840 16167 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34047/jwks.json
12:13:43.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512823927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:43.931 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.931 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.931 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.931 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.931 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.931 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.932 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.932 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.932 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.932 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.935 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:13:43.936 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.951249 16167 master_runner.cc:387] Master server non-default flags:
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.189:34023
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data/info.pb
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.189
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:43.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/logs
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.952488 16167 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:43.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.954038 16167 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:43.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.963697 16176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:43.971 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:43.971 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:43.972 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:43.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:43.973 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:43.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:43.975 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:43.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:43.980172 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 4
12:13:43.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.985715 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:44.143 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:44.230 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:44.231 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:44.231 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:44.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.232 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.233 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.233 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.233 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.233 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.233 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.233 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:44.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:44.285110 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 5
12:13:44.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:44.291890 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:44.296 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:44.297 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:44.297 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:44.298 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.298 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.298 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.298 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.299 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.299 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.299 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.299 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.299 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:44.431 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512824429 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:44.440 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:44.440 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:44.441 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:44.441 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.441 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.441 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.442 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.442 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.442 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.443 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:44.447 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:44.447 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:44.448 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:44.448 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.448 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.448 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:44.448 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.449 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.449 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:44.449 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.449 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.449 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:44.449 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:44.454 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=24 ms, finalizationTime=1 ms).
12:13:44.457 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:13:44.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:44.735 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:44.735 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:44.736 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:44.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:44.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:44.737 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.738 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.738 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:44.738 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:44.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:44.840442 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 6
12:13:44.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:44.875450 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.189:34023: Network error: Client connection negotiation failed: client connection to 127.15.167.189:34023: connect: Connection refused (error 111)
12:13:44.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512824928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:44.943 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:13:44.944 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:13:44.959 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:44.960 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:44.960 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:44.960 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:44.960 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:44.960 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:44.960 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:44.960 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:44.960 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:44.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:44.960 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:44.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:44.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:45.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:45.151 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:45.152 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:45.152 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:45.153 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.153 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.153 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.153 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.153 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.154 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.154 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.154 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.154 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.367867 16175 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 16167
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.396816 16175 kernel_stack_watchdog.cc:198] Thread 16167 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:43.965309 16177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:45.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.397552 16167 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.433s	user 0.002s	sys 0.000s
12:13:45.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.397909 16167 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.433s	user 0.002s	sys 0.000s
12:13:45.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.398332 16178 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1432 milliseconds
12:13:45.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.403024 16179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:45.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.403043 16167 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:45.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.404407 16167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:45.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.406983 16167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:45.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.408385 16167 hybrid_clock.cc:648] HybridClock initialized: now 1783512825408315 us; error 66 us; skew 500 ppm
12:13:45.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.409159 16167 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:45.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.415088 16167 webserver.cc:533] Webserver started at http://127.15.167.189:33363/ using document root <none> and password file <none>
12:13:45.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.415910 16167 fs_manager.cc:362] Metadata directory not provided
12:13:45.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.416083 16167 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:45.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.416476 16167 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.420497 16167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data/instance:
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1eb734c4f2d4c42b7096142f9395179"
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:45 on dist-test-slave-vcgh"
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.421638 16167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal/instance:
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1eb734c4f2d4c42b7096142f9395179"
12:13:45.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:45 on dist-test-slave-vcgh"
12:13:45.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.428539 16167 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
12:13:45.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512825428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:45.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.435758 16189 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:45.436 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:13:45.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:13:45.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.437353 16167 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.004s
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.437626 16167 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1eb734c4f2d4c42b7096142f9395179"
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:45 on dist-test-slave-vcgh"
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.438009 16167 fs_report.cc:389] FS layout report
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data/data
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:45.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:45.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.496443 16167 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:45.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.497967 16167 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:45.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.498413 16167 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:45.522 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:45.523 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:45.523 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:45.523 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.523 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.523 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:45.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:45.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:45.524 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:45.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.570000 16167 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.189:34023
12:13:45.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.570111 16240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.189:34023 every 8 connection(s)
12:13:45.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.572662 16167 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/data/info.pb
12:13:45.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.578508 16241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.581106 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16167
12:13:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.581423 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-1/wal/instance
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.583292 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/logs
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data/info.pb
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:45.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.188:40073
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.188
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:45.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json with env {}
12:13:45.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.591830 16241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } has no permanent_uuid. Determining permanent_uuid...
12:13:45.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.626175 16241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } has no permanent_uuid. Determining permanent_uuid...
12:13:45.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.640911 16241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } has no permanent_uuid. Determining permanent_uuid...
12:13:45.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:45.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.643501 16190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.647547 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.697084 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 1
12:13:45.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.701422 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.769759 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 2
12:13:45.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.773999 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.865406 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 3
12:13:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.869411 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:45.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:45.895 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:45.895 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:45.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:45.896 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:45.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:45.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:45.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:45.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:45.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:45.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:45.896 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:45.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.899714 16243 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:45.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.900375 16243 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:45.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.900969 16243 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:45.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512825928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:45.935 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:13:45.936 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.935954 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } attempt: 7
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.936620 16243 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.937022 16243 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.937366 16243 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.937705 16243 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.938031 16243 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:13:45.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.938294 16243 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34047/jwks.json
12:13:45.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.948064 16165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } has no permanent_uuid. Determining permanent_uuid...
12:13:45.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:45.953739 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.994655 16243 master_runner.cc:387] Master server non-default flags:
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.188:40073
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34047/jwks.json
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data/info.pb
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.188
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/logs
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:45.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:45.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.996142 16243 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:45.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:45.997814 16243 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:46.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.009016 16255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:46.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.012111 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 1
12:13:46.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.013232 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 4
12:13:46.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.024868 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.025787 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.107220 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 2
12:13:46.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.111614 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:46.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.196913 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 3
12:13:46.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.201318 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.324306 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 5
12:13:46.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.328533 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.341634 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 4
12:13:46.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.345754 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512826428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:46.436 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:13:46.436 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:13:46.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.629103 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 5
12:13:46.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.637112 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:46.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.875908 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 6
12:13:46.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.882611 16241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:46.910 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:46.911 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:46.911 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:46.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:46.911 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:46.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:46.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:46.911 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:46.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:46.911 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:46.911 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:46.912 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:46.912 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:46.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512826928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:46.937 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:13:46.937 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:13:47.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:47.179 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:47.179 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:47.179 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:47.179 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:47.179 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:47.180 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:47.180 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:47.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:47.180 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:47.180 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:47.180 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:47.180 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:47.180 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:47.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.189519 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 6
12:13:47.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.009548 16256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:47.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:46.029736 16258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:47.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:46.029600 16243 server_base.cc:1061] running on GCE node
12:13:47.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.196277 16165 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.167.188:40073: Network error: Client connection negotiation failed: client connection to 127.15.167.188:40073: connect: Connection refused (error 111)
12:13:47.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.197376 16243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:47.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.200048 16243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:47.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.201395 16243 hybrid_clock.cc:648] HybridClock initialized: now 1783512827201359 us; error 31 us; skew 500 ppm
12:13:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.202201 16243 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:47.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.208170 16243 webserver.cc:533] Webserver started at http://127.15.167.188:39207/ using document root <none> and password file <none>
12:13:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.209053 16243 fs_manager.cc:362] Metadata directory not provided
12:13:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.209290 16243 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:47.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.209678 16243 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:47.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.214268 16243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data/instance:
12:13:47.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff43a6df131848279354a5bb5e5a85a8"
12:13:47.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:47 on dist-test-slave-vcgh"
12:13:47.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.215512 16243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal/instance:
12:13:47.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff43a6df131848279354a5bb5e5a85a8"
12:13:47.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:47 on dist-test-slave-vcgh"
12:13:47.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.222414 16243 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
12:13:47.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.227895 16270 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.228998 16243 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:13:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.229274 16243 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal
12:13:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ff43a6df131848279354a5bb5e5a85a8"
12:13:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:47 on dist-test-slave-vcgh"
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.229559 16243 fs_report.cc:389] FS layout report
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data/data
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:47.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:47.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.271262 16243 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:47.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.272930 16243 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:47.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.273370 16243 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:47.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.349015 16243 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.188:40073
12:13:47.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.349129 16321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.188:40073 every 8 connection(s)
12:13:47.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.351694 16243 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/data/info.pb
12:13:47.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.357487 16322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:47.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.362087 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16243
12:13:47.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.362555 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/master-2/wal/instance
12:13:47.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.370378 16322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } has no permanent_uuid. Determining permanent_uuid...
12:13:47.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.403869 16322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } has no permanent_uuid. Determining permanent_uuid...
12:13:47.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.421412 16322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } has no permanent_uuid. Determining permanent_uuid...
12:13:47.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512827428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:47.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.443173 16322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: Bootstrap starting.
12:13:47.445 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:13:47.447 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:13:47.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.450616 16322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: Neither blocks nor log segments found. Creating new log.
12:13:47.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.452260 16322 log.cc:826] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: Log is configured to *not* fsync() on all Append() calls
12:13:47.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.457345 16322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: No bootstrap required, opened a new log
12:13:47.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.477567 16322 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:47.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.478386 16322 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:47.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.478670 16322 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff43a6df131848279354a5bb5e5a85a8, State: Initialized, Role: FOLLOWER
12:13:47.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.479542 16322 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.481876 16333 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.482451 16333 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: This master's current role is: FOLLOWER
12:13:47.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.483165 16322 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: configured and running, proceeding with master startup.
12:13:47.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.506870 16333 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:47.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.507409 16333 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:47.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.508009 16344 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:13:47.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.508317 16344 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:13:47.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.509902 16333 leader_election.cc:290] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90f43a189de44d36b3d53517ba62a41b (127.15.167.190:46157), d1eb734c4f2d4c42b7096142f9395179 (127.15.167.189:34023)
12:13:47.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.528172 16276 tablet.cc:2406] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:47.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.504385 16243 master_runner.cc:187] Error getting master registration for 127.15.167.190:46157: OK, instance_id { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" instance_seqno: 1783512823542608 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:47.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.533571 16243 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:47.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:47.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.656230 15369 debug-util.cc:398] Leaking SignalData structure 0x7b0800094c00 after lost signal to thread 15306
12:13:47.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:47.657418 15369 debug-util.cc:398] Leaking SignalData structure 0x7b080008d380 after lost signal to thread 15372
12:13:47.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512827927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:47.937 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:13:47.938 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:13:47.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.943094 16241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 7
12:13:47.976 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:47.976 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:47.977 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:47.977 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:47.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:47.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:47.977 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:47.977 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:47.978 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:47.978 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:47.978 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:47.978 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:47.978 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:47.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.980099 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: Bootstrap starting.
12:13:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.987783 16241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: Neither blocks nor log segments found. Creating new log.
12:13:47.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:47.990160 16241 log.cc:826] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: Log is configured to *not* fsync() on all Append() calls
12:13:48.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.011739 16241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: No bootstrap required, opened a new log
12:13:48.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.040086 16241 raft_consensus.cc:359] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.040915 16241 raft_consensus.cc:385] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:48.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.041215 16241 raft_consensus.cc:740] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1eb734c4f2d4c42b7096142f9395179, State: Initialized, Role: FOLLOWER
12:13:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.042310 16241 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.052217 16350 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.053830 16241 sys_catalog.cc:565] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: configured and running, proceeding with master startup.
12:13:48.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.054032 16216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff43a6df131848279354a5bb5e5a85a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1eb734c4f2d4c42b7096142f9395179" is_pre_election: true
12:13:48.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.054829 16216 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff43a6df131848279354a5bb5e5a85a8 in term 0.
12:13:48.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.053603 16350 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.056258 16274 leader_election.cc:304] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1eb734c4f2d4c42b7096142f9395179, ff43a6df131848279354a5bb5e5a85a8; no voters: 
12:13:48.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.058526 16352 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.058964 16352 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:48.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.059365 16352 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 0 FOLLOWER]: Advancing to term 1
12:13:48.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.068203 16352 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.073364 16216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff43a6df131848279354a5bb5e5a85a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1eb734c4f2d4c42b7096142f9395179"
12:13:48.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.073915 16216 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 0 FOLLOWER]: Advancing to term 1
12:13:48.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.089774 16216 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff43a6df131848279354a5bb5e5a85a8 in term 1.
12:13:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.091172 16274 leader_election.cc:304] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1eb734c4f2d4c42b7096142f9395179, ff43a6df131848279354a5bb5e5a85a8; no voters: 
12:13:48.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.096951 16352 leader_election.cc:290] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [CANDIDATE]: Term 1 election: Requested vote from peers 90f43a189de44d36b3d53517ba62a41b (127.15.167.190:46157), d1eb734c4f2d4c42b7096142f9395179 (127.15.167.189:34023)
12:13:48.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.098009 16352 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 1 FOLLOWER]: Leader election won for term 1
12:13:48.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.099506 16352 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [term 1 LEADER]: Becoming Leader. State: Replica: ff43a6df131848279354a5bb5e5a85a8, State: Running, Role: LEADER
12:13:48.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.100831 16352 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.128095 16354 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff43a6df131848279354a5bb5e5a85a8. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.129045 16354 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: This master's current role is: LEADER
12:13:48.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.135201 16359 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:13:48.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:48.143 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:48.144 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:48.144 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:48.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.144 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.145 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:48.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.145553 16359 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:13:48.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.174876 16366 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:13:48.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.176752 16216 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [term 1 FOLLOWER]: Refusing update from remote peer ff43a6df131848279354a5bb5e5a85a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:48.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.178828 16354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.179169 16167 master_runner.cc:187] Error getting master registration for 127.15.167.190:46157: OK, instance_id { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" instance_seqno: 1783512823542608 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:13:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.211545 16167 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:13:48.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.229640 16165 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } attempt: 7
12:13:48.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.232451 16350 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff43a6df131848279354a5bb5e5a85a8. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.233165 16350 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.248996 16364 mvcc.cc:204] Tried to move back new op lower bound from 7305268544190717952 to 7305268543923212288. Current Snapshot: MvccSnapshot[applied={T|T < 7305268544190717952}]
12:13:48.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.265805 16352 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.266538 16352 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: This master's current role is: LEADER
12:13:48.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.266996 16165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: Bootstrap starting.
12:13:48.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.269754 16359 catalog_manager.cc:1383] Generated new cluster ID: c02c78d40816401bb88440fcfeb47231
12:13:48.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.270035 16359 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:13:48.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.276750 16165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: Neither blocks nor log segments found. Creating new log.
12:13:48.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.279074 16165 log.cc:826] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: Log is configured to *not* fsync() on all Append() calls
12:13:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.287423 16367 mvcc.cc:204] Tried to move back new op lower bound from 7305268544190717952 to 7305268543923212288. Current Snapshot: MvccSnapshot[applied={T|T < 7305268544190717952}]
12:13:48.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.293748 16165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: No bootstrap required, opened a new log
12:13:48.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.310299 16350 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.310976 16350 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179 [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.365592 16359 catalog_manager.cc:1406] Generated new certificate authority record
12:13:48.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.370595 16359 catalog_manager.cc:1540] Loading token signing keys...
12:13:48.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.422178 16165 raft_consensus.cc:359] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.424418 16165 raft_consensus.cc:385] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:48.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.425372 16165 raft_consensus.cc:740] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90f43a189de44d36b3d53517ba62a41b, State: Initialized, Role: FOLLOWER
12:13:48.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512828428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:48.445 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:13:48.446 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:13:48.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.427716 16165 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } }
12:13:48.467 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:48.467 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:48.468 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:48.468 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.468 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.469 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.469 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.469 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.469 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.470 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:48.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.471369 16373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.472182 16373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.473694 16359 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8: Generated new TSK 0
12:13:48.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.474822 16359 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:13:48.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.480799 16139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff43a6df131848279354a5bb5e5a85a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90f43a189de44d36b3d53517ba62a41b"
12:13:48.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.481593 16139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 0 FOLLOWER]: Advancing to term 1
12:13:48.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.484886 16140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ff43a6df131848279354a5bb5e5a85a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90f43a189de44d36b3d53517ba62a41b" is_pre_election: true
12:13:48.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.490676 16139 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff43a6df131848279354a5bb5e5a85a8 in term 1.
12:13:48.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.492113 16138 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [term 1 FOLLOWER]: Refusing update from remote peer ff43a6df131848279354a5bb5e5a85a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.499127 16354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.500545 16165 sys_catalog.cc:565] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: configured and running, proceeding with master startup.
12:13:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:48.500825 16119 tablet.cc:2406] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.518373 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:48.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/logs
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data/info.pb
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.129:0
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.129
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.129
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:48.576 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:48.577 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:48.577 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:48.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.578 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.578 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.578 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.578 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.579 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.579 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.579 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:48.616 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:48.617 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:48.617 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:48.618 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:48.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:48.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:48.619 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:48.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.631822 16373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff43a6df131848279354a5bb5e5a85a8. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.632515 16373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.632261 16380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.632978 16380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b [sys.catalog]: This master's current role is: FOLLOWER
12:13:48.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:48.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.645790 16390 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:13:48.859 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [10ms] received response from server master-127.12.238.252:39469: OK, deferred=null) with no deferred attached!
12:13:48.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.891441 16354 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ff43a6df131848279354a5bb5e5a85a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90f43a189de44d36b3d53517ba62a41b" member_type: VOTER last_known_addr { host: "127.15.167.190" port: 46157 } } peers { permanent_uuid: "d1eb734c4f2d4c42b7096142f9395179" member_type: VOTER last_known_addr { host: "127.15.167.189" port: 34023 } } peers { permanent_uuid: "ff43a6df131848279354a5bb5e5a85a8" member_type: VOTER last_known_addr { host: "127.15.167.188" port: 40073 } } }
12:13:48.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:48.892163 16354 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43a6df131848279354a5bb5e5a85a8 [sys.catalog]: This master's current role is: LEADER
12:13:48.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512828928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:48.942 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:13:48.943 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:13:48.994 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:48.995 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:48.995 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:48.996 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:48.996 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:48.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:48.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:48.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:48.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:48.997 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:48.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:48.997 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:48.997 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:49.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.119339 16377 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:49.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.120225 16377 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:49.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.121100 16377 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:49.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:49.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.178231 16377 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:49.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.179766 16377 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.167.129
12:13:49.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.191587 16366 catalog_manager.cc:1295] Loaded cluster ID: c02c78d40816401bb88440fcfeb47231
12:13:49.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.193753 16366 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: loading cluster ID for follower catalog manager: success
12:13:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.208935 16366 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: acquiring CA information for follower catalog manager: success
12:13:49.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.232898 16366 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d1eb734c4f2d4c42b7096142f9395179: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.242630 16377 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.129:0
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data/info.pb
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.129
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.129
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/logs
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.245296 16377 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:49.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.247599 16377 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:49.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.280428 16398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:49.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512829428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:49.446 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:13:49.447 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:13:49.491 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:49.491 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:49.492 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:49.493 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:49.493 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:49.493 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:49.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:49.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:49.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:49.494 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:49.494 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:49.494 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:49.494 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:49.564 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [21ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.564 [DEBUG - pool-54-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [22ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.635 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [11ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.635 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [12ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.635 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [12ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.635 [DEBUG - pool-58-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [27ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:49.658 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [11ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.658 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [10ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.659 [DEBUG - pool-56-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30007), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [8ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.659204 16390 catalog_manager.cc:1295] Loaded cluster ID: c02c78d40816401bb88440fcfeb47231
12:13:49.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.660617 16390 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: loading cluster ID for follower catalog manager: success
12:13:49.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.678738 16390 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: acquiring CA information for follower catalog manager: success
12:13:49.683 [DEBUG - pool-52-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.13.164.252:40513, [5ms] received response from server master-127.13.164.252:40513: OK, deferred=null) with no deferred attached!
12:13:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:49.694676 16390 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 90f43a189de44d36b3d53517ba62a41b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:13:49.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512829928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:49.944 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:13:49.946 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
12:13:50.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:50.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512830428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:50.439 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:13:50.440 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
12:13:50.539 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:50.540 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:50.540 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:50.540 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:50.540 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:50.540 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:50.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:50.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:50.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:50.540 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:50.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:50.541 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:50.541 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:50.619 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [3ms] received response from server master-127.12.238.252:39469: OK, deferred=null) with no deferred attached!
12:13:50.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:50.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512830928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:50.939 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:13:50.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
12:13:51.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:51.218 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:51.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:51.219 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:51.219 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:51.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:51.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:51.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:51.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:51.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:51.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:51.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:51.220 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:51.220 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:51.222 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:51.223 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:51.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.223 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:51.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.223 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.223 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.223 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.223 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.223 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.223 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:51.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512831428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:51.441 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:13:51.442 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
12:13:51.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:49.285594 16399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:51.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:50.674785 16397 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 16377
12:13:51.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:51.533284 16377 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.249s	user 0.728s	sys 1.049s
12:13:51.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:51.541253 16377 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.258s	user 0.728s	sys 1.049s
12:13:51.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:51.553290 16406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:51.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.555207 16377 server_base.cc:1061] running on GCE node
12:13:51.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.556428 16377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:51.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.578912 16377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:51.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.584666 16377 hybrid_clock.cc:648] HybridClock initialized: now 1783512831584616 us; error 49 us; skew 500 ppm
12:13:51.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.585964 16377 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:51.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.611861 16377 webserver.cc:533] Webserver started at http://127.15.167.129:37569/ using document root <none> and password file <none>
12:13:51.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.613301 16377 fs_manager.cc:362] Metadata directory not provided
12:13:51.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.613729 16377 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:51.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.614434 16377 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.628656 16377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data/instance:
12:13:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f"
12:13:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:51 on dist-test-slave-vcgh"
12:13:51.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.631496 16377 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal/instance:
12:13:51.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f"
12:13:51.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:51 on dist-test-slave-vcgh"
12:13:51.645 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:51.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.651298 16377 fs_manager.cc:696] Time spent creating directory manager: real 0.017s	user 0.005s	sys 0.007s
12:13:51.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.664048 16411 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:51.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.665519 16377 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.009s	sys 0.000s
12:13:51.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.666023 16377 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal
12:13:51.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f"
12:13:51.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:51 on dist-test-slave-vcgh"
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.666594 16377 fs_report.cc:389] FS layout report
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data/data
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:51.715 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:51.716 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:51.716 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:51.717 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:51.717 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:51.717 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:51.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:51.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:51.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:51.718 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:51.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:51.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:51.718 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.738515 16377 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:51.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.740598 16377 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:51.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.741302 16377 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:51.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.744809 16377 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.750419 16377 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.750685 16377 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.750991 16377 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:51.751199 16377 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:51.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:51.829195 15369 debug-util.cc:398] Leaking SignalData structure 0x7b080007f380 after lost signal to thread 15306
12:13:51.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:51.829843 15369 debug-util.cc:398] Leaking SignalData structure 0x7b080007ba20 after lost signal to thread 15372
12:13:51.868 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:51.868 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:51.868 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:51.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.869 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:51.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512831927 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:51.939 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:13:51.940 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
12:13:51.956 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:51.956 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:51.957 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:51.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:51.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:51.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.958 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:51.958 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:52.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.064802 16377 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.129:41401
12:13:52.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.065371 16524 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.129:41401 every 8 connection(s)
12:13:52.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.069253 16377 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/data/info.pb
12:13:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.076561 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16377
12:13:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.077119 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-0/wal/instance
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.089653 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/logs
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data/info.pb
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.130:0
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.130
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.130
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:52.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:52.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:52.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.168843 16531 heartbeater.cc:344] Connected to a master server at 127.15.167.190:46157
12:13:52.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.169345 16531 heartbeater.cc:461] Registering TS with master...
12:13:52.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.170737 16531 heartbeater.cc:507] Master 127.15.167.190:46157 requested a full tablet report, sending...
12:13:52.175 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:52.175 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:52.175 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:52.176 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:52.176 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:52.176 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:52.176 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:52.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:52.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:52.176 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:52.176 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:52.176 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:52.177 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:52.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.178704 16530 heartbeater.cc:344] Connected to a master server at 127.15.167.189:34023
12:13:52.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.179064 16530 heartbeater.cc:461] Registering TS with master...
12:13:52.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.179965 16530 heartbeater.cc:507] Master 127.15.167.189:34023 requested a full tablet report, sending...
12:13:52.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.178179 16130 ts_manager.cc:194] Registered new tserver with Master: b6281af7c1bc4e3d9e516eac6adeaf1f (127.15.167.129:41401)
12:13:52.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.183099 16206 ts_manager.cc:194] Registered new tserver with Master: b6281af7c1bc4e3d9e516eac6adeaf1f (127.15.167.129:41401)
12:13:52.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.186470 16526 heartbeater.cc:344] Connected to a master server at 127.15.167.188:40073
12:13:52.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.186807 16526 heartbeater.cc:461] Registering TS with master...
12:13:52.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.187713 16526 heartbeater.cc:507] Master 127.15.167.188:40073 requested a full tablet report, sending...
12:13:52.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.190136 16287 ts_manager.cc:194] Registered new tserver with Master: b6281af7c1bc4e3d9e516eac6adeaf1f (127.15.167.129:41401)
12:13:52.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.192767 16287 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.167.129:35937
12:13:52.428 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512832428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:52.437 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:13:52.438 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
12:13:52.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.531193 16161 debug-util.cc:398] Leaking SignalData structure 0x7b08000a29c0 after lost signal to thread 16043
12:13:52.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.551020 16529 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:52.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.551653 16529 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:52.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.552376 16529 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:52.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.610446 16529 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:52.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.611824 16529 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.167.130
12:13:52.618 [DEBUG - pool-50-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [4ms] received response from server master-127.12.238.252:39469: OK, deferred=null) with no deferred attached!
12:13:52.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.674800 16529 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.130:0
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data/info.pb
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.130
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.130
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/logs
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:52.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:52.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:52.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.676514 16529 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:52.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:52.678660 16529 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:52.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.696244 16543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:52.831 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:52.831 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:52.831 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:52.832 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:52.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:52.832 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:52.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:52.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:52.833 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:52.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:52.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:52.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:52.833 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:52.928 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512832928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:52.936 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:13:52.937 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
12:13:53.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:53.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:53.196491 16526 heartbeater.cc:499] Master 127.15.167.188:40073 was elected leader, sending a full tablet report...
12:13:53.203 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:53.203 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:53.203 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:53.204 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:53.204 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:53.204 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:53.205 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:53.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:53.205 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:53.205 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:53.205 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:53.205 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:53.205 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:53.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512833428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:53.436 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:13:53.437 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
12:13:53.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:53.779 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:53.779 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:53.779 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:53.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:53.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:53.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:53.780 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:53.780 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:53.780 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:53.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:53.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:53.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:53.781 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:53.929 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512833928 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:53.938 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:13:53.939 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
12:13:54.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:54.429 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 71 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512834428 for job 8680f415d5d255088cd51ec1e8014bb4.
12:13:54.438 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 71 for job 8680f415d5d255088cd51ec1e8014bb4 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:13:54.439 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 71 as completed for source Source: KuduSource.
12:13:54.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.095329 16541 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 16529
12:13:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.570748 16541 kernel_stack_watchdog.cc:198] Thread 16529 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 397ms:
12:13:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:13:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:13:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:13:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:13:54.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.572301 16529 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.876s	user 0.528s	sys 0.840s
12:13:54.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.572631 16529 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.877s	user 0.528s	sys 0.840s
12:13:54.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:52.698279 16542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:54.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.573920 16545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:54.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:54.577926 16544 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1876 milliseconds
12:13:54.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.577942 16529 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:13:54.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.579300 16529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.589232 16529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:54.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.590708 16529 hybrid_clock.cc:648] HybridClock initialized: now 1783512834590672 us; error 44 us; skew 500 ppm
12:13:54.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.591655 16529 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:54.598 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.599 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.599 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.599 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.599 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.599 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.600 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.600 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.600 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.601 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.601 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.601 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.602 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29999), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [24ms] received response from server master-127.12.238.252:39469: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [24ms] delaying RPC due to: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [60ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [79ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [79ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [99ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [139ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [199ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [257ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [417ms] refreshing cache from master, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [419ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [419ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [697ms] refreshing cache from master, [697ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [699ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1297ms] refreshing cache from master, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1298ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2216ms] refreshing cache from master, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2218ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5636ms] refreshing cache from master, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5638ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5638ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [5639ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [8616ms] refreshing cache from master, [8617ms] too many traces: truncated at 100 traces, deferred=Deferred@457095637(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@6db5fa64 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173)))
12:13:54.602 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.603 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.603 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.603 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29999), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [24ms] received response from server master-127.12.238.252:39469: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [24ms] delaying RPC due to: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [60ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [79ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [79ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [99ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [139ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [199ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [257ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [417ms] refreshing cache from master, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [419ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [419ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [697ms] refreshing cache from master, [697ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [699ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1297ms] refreshing cache from master, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1298ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2216ms] refreshing cache from master, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2218ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5636ms] refreshing cache from master, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5638ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5638ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [5639ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [8616ms] refreshing cache from master, [8617ms] too many traces: truncated at 100 traces, deferred=Deferred@457095637(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@6db5fa64 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29999), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [24ms] received response from server master-127.12.238.252:39469: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [24ms] delaying RPC due to: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [60ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [79ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [79ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [99ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [139ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [199ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [257ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [417ms] refreshing cache from master, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [419ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [419ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [697ms] refreshing cache from master, [697ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [699ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1297ms] refreshing cache from master, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1298ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2216ms] refreshing cache from master, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2218ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5636ms] refreshing cache from master, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5638ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5638ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [5639ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [8616ms] refreshing cache from master, [8617ms] too many traces: truncated at 100 traces, deferred=Deferred@457095637(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@6db5fa64 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:54.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.605 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.605 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.605 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.605 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.615 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29999), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [24ms] received response from server master-127.12.238.252:39469: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [24ms] delaying RPC due to: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [60ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [79ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [79ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [99ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [139ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [199ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [257ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [417ms] refreshing cache from master, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [419ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [419ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [697ms] refreshing cache from master, [697ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [699ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1297ms] refreshing cache from master, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1298ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2216ms] refreshing cache from master, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2218ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5636ms] refreshing cache from master, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5638ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5638ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [5639ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [8616ms] refreshing cache from master, [8617ms] too many traces: truncated at 100 traces, deferred=Deferred@457095637(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@6db5fa64 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=29999), Traces: [0ms] sending RPC to server master-127.12.238.252:39469, [24ms] received response from server master-127.12.238.252:39469: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [24ms] delaying RPC due to: Network error: [peer master-127.12.238.252:39469(127.12.238.252:39469)] unexpected exception from downstream on [id: 0x87639011, L:/127.0.0.1:53168 - R:/127.12.238.252:39469], [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [60ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [60ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [78ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [79ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [79ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [99ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [99ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [137ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [138ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [139ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [196ms] refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [198ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [199ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [257ms] refreshing cache from master, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [257ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [258ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [259ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [417ms] refreshing cache from master, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [418ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [419ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [419ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [697ms] refreshing cache from master, [697ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [698ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [699ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [699ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1297ms] refreshing cache from master, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1297ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1298ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1298ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2216ms] refreshing cache from master, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2218ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2218ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5636ms] refreshing cache from master, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5637ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5638ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5638ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5639ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [5639ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [8616ms] refreshing cache from master, [8617ms] too many traces: truncated at 100 traces, deferred=Deferred@457095637(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@6db5fa64 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@1347593934 after retry RPC after error@896555946) -> (continuation of Deferred@1542368448 after retry RPC after error@432671491) -> (continuation of Deferred@1558948386 after retry RPC after error@1802573598) -> (continuation of Deferred@1163341340 after retry RPC after error@202155942) -> (continuation of Deferred@221755071 after retry RPC after error@1855822304) -> (continuation of Deferred@306609633 after retry RPC after error@2074003864) -> (continuation of Deferred@1269565978 after retry RPC after error@1232918550) -> (continuation of Deferred@1752436141 after retry RPC after error@1697368882) -> (continuation of Deferred@1316806999 after retry RPC after error@1634675942) -> (continuation of Deferred@691952643 after retry RPC after error@309817421) -> (continuation of Deferred@992501005 after retry RPC after error@590892690) -> (continuation of Deferred@2017317042 after retry RPC after error@1365320416) -> (continuation of Deferred@685301236 after retry RPC after error@1232423587) -> (continuation of Deferred@1608231807 after retry RPC after error@133555270) -> (continuation of Deferred@1764539953 after retry RPC after error@175096293) -> (continuation of Deferred@149754756 after retry RPC after error@538054923) -> (continuation of Deferred@751042062 after retry RPC after error@1490514586) -> (continuation of Deferred@952515383 after retry RPC after error@149745517) -> (continuation of Deferred@1005339632 after retry RPC after error@1481422261) -> (continuation of Deferred@1364861448 after retry RPC after error@1042430153) -> (continuation of Deferred@1728585534 after retry RPC after error@1523904375) -> (continuation of Deferred@1511967815 after retry RPC after error@1968522173)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:13:54.616 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:13:54.616 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:13:54.617 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:13:54.617 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
12:13:54.617 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:54.617 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:13:54.617 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:54.618 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
12:13:54.618 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:13:54.618 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:13:54.618 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:13:54.618 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:13:54.618 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:13:54.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.620 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.620 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.620 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.620 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.620 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.621 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.621 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.621 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.621 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.621 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state TERMINATED
12:13:54.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] disconnecting while in state TERMINATED
12:13:54.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state TERMINATED
12:13:54.625 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state TERMINATED
12:13:54.625 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:54.626 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:13:54.627 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
12:13:54.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.626392 16529 webserver.cc:533] Webserver started at http://127.15.167.130:41307/ using document root <none> and password file <none>
12:13:54.627 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:13:54.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.627707 16529 fs_manager.cc:362] Metadata directory not provided
12:13:54.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.627983 16529 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:54.629 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:54.629 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:13:54.629 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:54.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.628837 16529 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:54.632 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:54.632 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:13:54.632 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:54.632 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state TERMINATED
12:13:54.632 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 06835ed424014fde8ab6c13d8ecf66a2(127.13.164.193:45803)] disconnecting while in state TERMINATED
12:13:54.632 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state TERMINATED
12:13:54.633 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state TERMINATED
12:13:54.633 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:54.633 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:54.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state TERMINATED
12:13:54.633 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:13:54.633 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:54.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state TERMINATED
12:13:54.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state TERMINATED
12:13:54.633 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] disconnecting while in state TERMINATED
12:13:54.634 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:54.634 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
12:13:54.634 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:13:54.634 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:13:54.634 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.13.164.254:45345(127.13.164.254:45345)] disconnecting while in state TERMINATED
12:13:54.634 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.13.164.252:40513(127.13.164.252:40513)] disconnecting while in state TERMINATED
12:13:54.635 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.13.164.253:36317(127.13.164.253:36317)] disconnecting while in state TERMINATED
12:13:54.635 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:13:54.635 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer c03677bb70fe49339876d767c1854656(127.13.164.195:38081)] disconnecting while in state TERMINATED
12:13:54.635 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:54.635 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:13:54.635 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:54.635 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:54.636 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:54.636 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:54.636 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:54.636 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:13:54.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:54.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:54.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:54.637 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:54.637 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:54.637 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:54.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:54.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:54.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:54.638 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:54.638 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:54.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.639 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.638104 16529 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data/instance:
12:13:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fae72a698ae8488684c64de402139058"
12:13:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:54 on dist-test-slave-vcgh"
12:13:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.639669 16529 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal/instance:
12:13:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fae72a698ae8488684c64de402139058"
12:13:54.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:54 on dist-test-slave-vcgh"
12:13:54.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.640 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.640 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.640 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:54.640 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.640 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.640 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.640 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.636 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:54.645 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:13:54.645 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:13:54.645 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:54.645 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:13:54.645 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:13:54.646 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:13:54.646 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:13:54.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.648614 16529 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
12:13:54.650 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
12:13:54.651 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
12:13:54.651 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:13:54.652 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:54.652 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:13:54.652 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:54.654 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
12:13:54.654 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:54.655 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:13:54.655 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:13:54.656 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:13:54.656 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:13:54.657 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:54.660 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.660 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.660 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.661 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.661 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.661 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.661 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.661 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.661 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.661 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.661 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.661 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.661 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.661144 16572 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:54.662 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
12:13:54.662 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:13:54.663 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:13:54.663 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:13:54.664 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.662565 16529 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.006s	sys 0.003s
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.662946 16529 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fae72a698ae8488684c64de402139058"
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:54 on dist-test-slave-vcgh"
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.663362 16529 fs_report.cc:389] FS layout report
12:13:54.664 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data/data
12:13:54.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:54.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:54.665 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:13:54.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.679 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.679 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.679 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.680 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.680 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.680 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.680 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.680 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.680 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.680 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.680 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.687 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:54.687 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:54.688 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:54.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.688 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.688 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.688 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.688 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:54.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.719 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.720 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.720 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.720 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.720 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.720 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.720 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.720 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.720 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.720 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.720 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.722793 16529 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:54.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.724675 16529 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:54.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.725242 16529 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:54.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.728638 16529 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:54.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.734321 16529 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:54.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.734575 16529 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:54.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.734849 16529 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:54.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.735041 16529 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:54.756 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:54.757 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:54.757 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:54.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:54.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.757 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.757 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:54.758 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.758 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.758 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:54.758 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:54.759 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.759 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.759 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.760 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.760 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.842 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.842 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.843 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.844 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.845 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.845 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.845 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.845 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.845 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.845 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.846 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.879 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:54.880 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:54.880 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:54.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.880 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.881 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:54.881 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:54.881 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.881 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.881 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:54.881 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.906018 16529 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.130:34817
12:13:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.906131 16684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.130:34817 every 8 connection(s)
12:13:54.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.909603 16529 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/data/info.pb
12:13:54.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.918136 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16529
12:13:54.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.918565 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-1/wal/instance
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.956305 16030 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:54.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/logs
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data/info.pb
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.131:0
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.131
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.131
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:54.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:13:54.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.982638 16685 heartbeater.cc:344] Connected to a master server at 127.15.167.188:40073
12:13:54.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.983174 16685 heartbeater.cc:461] Registering TS with master...
12:13:54.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.984547 16685 heartbeater.cc:507] Master 127.15.167.188:40073 requested a full tablet report, sending...
12:13:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.988538 16287 ts_manager.cc:194] Registered new tserver with Master: fae72a698ae8488684c64de402139058 (127.15.167.130:34817)
12:13:54.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.990185 16287 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.167.130:57725
12:13:54.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.991195 16687 heartbeater.cc:344] Connected to a master server at 127.15.167.190:46157
12:13:54.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.991585 16687 heartbeater.cc:461] Registering TS with master...
12:13:54.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.992676 16687 heartbeater.cc:507] Master 127.15.167.190:46157 requested a full tablet report, sending...
12:13:54.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:54.995299 16130 ts_manager.cc:194] Registered new tserver with Master: fae72a698ae8488684c64de402139058 (127.15.167.130:34817)
12:13:55.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.006461 16686 heartbeater.cc:344] Connected to a master server at 127.15.167.189:34023
12:13:55.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.006804 16686 heartbeater.cc:461] Registering TS with master...
12:13:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.007436 16686 heartbeater.cc:507] Master 127.15.167.189:34023 requested a full tablet report, sending...
12:13:55.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.010346 16206 ts_manager.cc:194] Registered new tserver with Master: fae72a698ae8488684c64de402139058 (127.15.167.130:34817)
12:13:55.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:55.199 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.199 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.200 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.200 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.200 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.200 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.200 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.200 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.200 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.200 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.200 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.282 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:55.283 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:55.283 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:55.283 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.283 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.283 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.283 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.284 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.284 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.284 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.284 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.327920 16695 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:13:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.328437 16695 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:13:55.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.329051 16695 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:13:55.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.364181 16695 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:13:55.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.365074 16695 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.167.131
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.404158 16695 tablet_server_runner.cc:78] Tablet server non-default flags:
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.167.148:34341
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.167.131:0
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data/info.pb
12:13:55.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.167.131
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.167.190:46157,127.15.167.189:34023,127.15.167.188:40073
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.167.131
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/logs
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:13:55.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:13:55.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.405817 16695 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:13:55.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:55.407541 16695 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:13:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.420150 16701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:55.619 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.620 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.620 [DEBUG - pool-50-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.621 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.622 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.622 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.622 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.623 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:13:55.624 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:13:55.624 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:13:55.625 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:13:55.629 [INFO - Thread-20] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:13:55.629 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:13:55.629 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:13:55.629 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:13:55.629 [DEBUG - Thread-20] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:13:55.629 [DEBUG - Thread-20] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:55.630 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:13:55.630 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:13:55.631 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:13:55.631 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
12:13:55.631 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:13:55.632 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
12:13:55.632 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:13:55.632 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:13:55.633 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:13:55.633 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:13:55.634 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:13:55.634 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:13:55.635 [INFO - Thread-20] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:13:55.635 [INFO - Thread-20] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:13:55.638 [DEBUG - Thread-20] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:55.638 [INFO - Thread-20] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:13:55.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:55.632 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
12:13:55.644 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:13:55.645 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
12:13:55.645 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:13:55.646 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
12:13:55.646 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:13:55.646 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
12:13:55.647 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:13:55.650 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:13:55.652 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:13:55.652 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:13:55.652 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:13:55.653 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a9a9b57
12:13:55.653 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:55.653 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:55.653 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:13:55.654 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:13:55.659 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@71d1e068
12:13:55.661 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:55.661 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:55.661 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:55.661 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:13:55.662 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:55.664 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:13:55.666 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:13:55.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
12:13:55.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
12:13:55.667 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:13:55.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5c35733a
12:13:55.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:55.668 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:13:55.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:55.668 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:13:55.668 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:13:55.668 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
12:13:55.669 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
12:13:55.670 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21f3dfc5
12:13:55.670 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:55.670 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:55.670 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:13:55.670 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:13:55.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
12:13:55.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
12:13:55.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d61bbe2
12:13:55.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:55.673 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:13:55.673 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:13:55.675 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:13:55.677 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@636f66a2
12:13:55.679 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@971264d
12:13:55.679 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:55.679 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a8ffbe4
12:13:55.682 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:55.682 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.684 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.685 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.686 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.687 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.688 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.688 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.689 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.692 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.693 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.693 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.694 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.696 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.696 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:55.697 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.697 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.697 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.697 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.698 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.698 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.699 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.699 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.700 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.700 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.700 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.701 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.702 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.703 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.704 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.705 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.705 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.705 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.705 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.706 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.706 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.707 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.707 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.707 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.707 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.707 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.708 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.713 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.717 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.719 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.719 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.719 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.719 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.720 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.720 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.722 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.722 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.722 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.723 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.724 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.724 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.725 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.725 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.725 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.725 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.725 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.726 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.726 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.727 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.727 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.727 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.727 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.728 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.728 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.728 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.729 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.729 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.729 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.729 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.730 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.730 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.730 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.732 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.734 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.734 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.735 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.735 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.735 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.735 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.735 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.736 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.736 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.736 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.736 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.736 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.737 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.737 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.737 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.737 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.737 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.738 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.738 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.738 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.738 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.738 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.739 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.739 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.739 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.739 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.740 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.740 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.740 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.740 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.740 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.740 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.743 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.743 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.743 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.744 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.745 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.745 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.745 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.746 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.747 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.747 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.747 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.747 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.747 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.747 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.747 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.748 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.748 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.748 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:55.750 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.750 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.750 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.750 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.750 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.750 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.751 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.751 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.751 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.751 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.751 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.752 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.752 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.752 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.753 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.753 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.753 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.753 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.753 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.753 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.753 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.754 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.754 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.754 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.754 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.754 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.763 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.763 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.764 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.764 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.764 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.764 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.765 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.765 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.765 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.765 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.765 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.765 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.765 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.766 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.766 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.766 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.766 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.766 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.767 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.767 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.767 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.768 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.768 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.768 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.769 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.769 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.769 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.769 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.769 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.770 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.771 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.771 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.771 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.771 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.772 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.772 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.772 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.772 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.772 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.773 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.773 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.773 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.773 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.783 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.783 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.784 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.784 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.784 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.784 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.785 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.785 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.785 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.785 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.785 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.785 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.785 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.786 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.786 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.786 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.787 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.788 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.788 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.788 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.789 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.789 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.789 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.789 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.789 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.789 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.789 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.790 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.790 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.790 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.791 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.791 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.791 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.791 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.791 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.791 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.791 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.791 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.791 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.791 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.791 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.792 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.792 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.792 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.793 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.793 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.793 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.794 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.803 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.804 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.804 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.805 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.805 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.805 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.806 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.806 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.806 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.808 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.808 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.808 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.808 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.810 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.811 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.811 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.811 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.812 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:55.812 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:55.812 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:55.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.813 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.813 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.813 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.813 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:55.814 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.814 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.814 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.814 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.815 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.815 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.815 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.815 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.823 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.823 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.824 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.824 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.824 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.824 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.824 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.824 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.824 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.825 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.825 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.825 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.825 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.826 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.826 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.826 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.826 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.826 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.828 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.863 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.871 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:55.871 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:55.871 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:55.872 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.872 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.872 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.872 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.872 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:55.872 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:55.872 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.873 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.873 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:55.873 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:55.873 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.873 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.874 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.875 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.875 [INFO - pool-104-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.875 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.875 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.876 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.876 [INFO - pool-104-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.876 [WARN - pool-104-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.883 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.884 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.884 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.884 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.884 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.884 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.885 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.885 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.886 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.887 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.887 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.888 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.888 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.888 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.888 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.923 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.924 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.924 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.924 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.924 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.925 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.925 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.925 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.925 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.926 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.926 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.927 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.927 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:55.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:55.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:55.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.928 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.928 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.928 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.928 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.928 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.929 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.929 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.929 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:55.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:55.930 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:55.931 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:55.956 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:55.957 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:55.957 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:55.957 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.957 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.957 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:55.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:55.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.959 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.959 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:55.959 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:56.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.000140 16685 heartbeater.cc:499] Master 127.15.167.188:40073 was elected leader, sending a full tablet report...
12:13:56.004 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:56.005 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:56.005 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:56.005 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.005 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.005 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.006 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.007 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.007 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.007 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.007 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.007 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.008 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.008 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.008 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.008 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.009 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.009 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.009 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.009 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.009 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.009 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.009 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:56.105 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:56.105 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:56.105 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:56.106 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.106 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.107 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.107 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.107 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.108 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:56.123 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.124 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.124 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.125 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.125 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.125 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.126 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.126 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.126 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.126 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.127 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.127 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.127 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.128 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.128 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.128 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.128 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.128 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:56.187 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.187 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.188 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.188 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.188 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.188 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.189 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.189 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.189 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:56.263 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.264 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.264 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.264 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.264 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.264 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.264 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.265 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.286 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.287 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.287 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.288 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.288 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.288 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.288 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.294 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:56.294 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:56.295 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:56.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:56.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:56.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:56.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:56.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:56.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:56.296 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:56.296 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:56.296 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:56.296 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:56.367 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:56.368 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:56.368 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:56.369 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:56.369 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:56.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:56.369 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:56.370 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:56.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:56.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:56.370 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:56.370 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:56.370 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:56.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.583 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.584 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.584 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.585 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.585 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.585 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.624 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.624 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:56.625 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.625 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:56.625 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.625 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:56.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.625 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.625 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.626 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.627 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:56.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.627 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.627 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.626 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:56.627 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:56.627 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:56.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:56.628 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.628 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.628 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:56.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:56.628 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:56.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:56.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:55.422245 16702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:56.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:56.662135 16695 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.243s	user 0.459s	sys 0.776s
12:13:56.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:56.662580 16695 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.243s	user 0.459s	sys 0.776s
12:13:56.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.664137 16695 server_base.cc:1061] running on GCE node
12:13:56.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:56.665676 16759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:13:56.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.666980 16695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:13:56.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.669495 16695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:13:56.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.671037 16695 hybrid_clock.cc:648] HybridClock initialized: now 1783512836670986 us; error 33 us; skew 500 ppm
12:13:56.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.672075 16695 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:13:56.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.680424 16695 webserver.cc:533] Webserver started at http://127.15.167.131:44949/ using document root <none> and password file <none>
12:13:56.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.681602 16695 fs_manager.cc:362] Metadata directory not provided
12:13:56.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.681872 16695 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:13:56.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.682405 16695 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:13:56.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.688424 16695 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data/instance:
12:13:56.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "730600ff807a48c88c8abc8aab572a15"
12:13:56.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:56 on dist-test-slave-vcgh"
12:13:56.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.689852 16695 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal/instance:
12:13:56.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "730600ff807a48c88c8abc8aab572a15"
12:13:56.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:56 on dist-test-slave-vcgh"
12:13:56.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.699304 16695 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
12:13:56.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.706499 16764 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:13:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.707747 16695 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
12:13:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.708117 16695 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal
12:13:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "730600ff807a48c88c8abc8aab572a15"
12:13:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:13:56 on dist-test-slave-vcgh"
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.708559 16695 fs_report.cc:389] FS layout report
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data/data
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:13:56.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:13:56.744 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:56.744 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:56.744 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:56.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.745 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:56.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:56.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:56.745 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:56.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:56.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.785223 16695 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:13:56.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.786789 16695 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:13:56.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.787302 16695 kserver.cc:163] Server-wide thread pool size limit: 3276
12:13:56.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.789841 16695 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:13:56.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.793856 16695 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:13:56.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.794040 16695 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:13:56.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.794260 16695 ts_tablet_manager.cc:616] Registered 0 tablets
12:13:56.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.794411 16695 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:13:56.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.937808 16695 rpc_server.cc:307] RPC server started. Bound to: 127.15.167.131:35147
12:13:56.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.937932 16876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.167.131:35147 every 8 connection(s)
12:13:56.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.940625 16695 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/data/info.pb
12:13:56.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.942550 16030 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 16695
12:13:56.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.942996 16030 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster10772873638703000239/ts-2/wal/instance
12:13:56.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.982151 16878 heartbeater.cc:344] Connected to a master server at 127.15.167.189:34023
12:13:56.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.982653 16878 heartbeater.cc:461] Registering TS with master...
12:13:56.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.983843 16878 heartbeater.cc:507] Master 127.15.167.189:34023 requested a full tablet report, sending...
12:13:56.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.987008 16206 ts_manager.cc:194] Registered new tserver with Master: 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:56.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.991257 16879 heartbeater.cc:344] Connected to a master server at 127.15.167.190:46157
12:13:56.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.991592 16879 heartbeater.cc:461] Registering TS with master...
12:13:56.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.992380 16879 heartbeater.cc:507] Master 127.15.167.190:46157 requested a full tablet report, sending...
12:13:56.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.994977 16129 ts_manager.cc:194] Registered new tserver with Master: 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:56.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.997098 16877 heartbeater.cc:344] Connected to a master server at 127.15.167.188:40073
12:13:56.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.997378 16877 heartbeater.cc:461] Registering TS with master...
12:13:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.998109 16877 heartbeater.cc:507] Master 127.15.167.188:40073 requested a full tablet report, sending...
12:13:57.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:56.999979 16286 ts_manager.cc:194] Registered new tserver with Master: 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:57.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.001910 16286 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.167.131:41809
12:13:57.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.017206 16030 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:13:57.028 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:13:57.028 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:13:57.029 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.167.190"
      port: 46157
    }
    bound_http_address {
      host: "127.15.167.190"
      port: 35943
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.167.189"
      port: 34023
    }
    bound_http_address {
      host: "127.15.167.189"
      port: 33363
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.167.188"
      port: 40073
    }
    bound_http_address {
      host: "127.15.167.188"
      port: 39207
    }
  }
}

12:13:57.029 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:13:57.030 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.167.129"
      port: 41401
    }
    bound_http_address {
      host: "127.15.167.129"
      port: 37569
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.167.130"
      port: 34817
    }
    bound_http_address {
      host: "127.15.167.130"
      port: 41307
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.167.131"
      port: 35147
    }
    bound_http_address {
      host: "127.15.167.131"
      port: 44949
    }
  }
}

12:13:57.030 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:13:57.032 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:57.033 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:13:57.034 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:13:57.035 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.239.126:41849(127.14.239.126:41849)] Successfully connected to peer
12:13:57.035 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:13:57.036 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.239.124:41311(127.14.239.124:41311)] Successfully connected to peer
12:13:57.043 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.239.125:46113(127.14.239.125:46113)] Successfully connected to peer
12:13:57.046 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.124
12:13:57.046 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.125
12:13:57.053 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.126
12:13:57.057 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.057 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.060 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa4d6a367, L:/127.0.0.1:58348 - R:/127.14.239.124:41311] using SASL/PLAIN
12:13:57.061 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd17cb164, L:/127.0.0.1:43736 - R:/127.14.239.125:46113] using SASL/PLAIN
12:13:57.063 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.066 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x77958697, L:/127.0.0.1:39640 - R:/127.14.239.126:41849] using SASL/PLAIN
12:13:57.067 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:57.067 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=33), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [32ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: OK, deferred=null) after lookup
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.069572 15494 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58348:
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:57.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:57.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:57.072582 15494 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:13:57.110 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:13:57.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:57.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.178891 15803 tablet_service.cc:1511] Processing CreateTablet for tablet a59af9fd5a334d8aa532b6997fcb0c67 (DEFAULT_TABLE table=replication_test_table [id=1adc360b8e5b4cbdbc66bfbfc8033ebb]), partition=
12:13:57.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.180671 15803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59af9fd5a334d8aa532b6997fcb0c67. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:57.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.187275 15954 tablet_service.cc:1511] Processing CreateTablet for tablet a59af9fd5a334d8aa532b6997fcb0c67 (DEFAULT_TABLE table=replication_test_table [id=1adc360b8e5b4cbdbc66bfbfc8033ebb]), partition=
12:13:57.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.188786 15954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59af9fd5a334d8aa532b6997fcb0c67. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:57.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.190459 15662 tablet_service.cc:1511] Processing CreateTablet for tablet a59af9fd5a334d8aa532b6997fcb0c67 (DEFAULT_TABLE table=replication_test_table [id=1adc360b8e5b4cbdbc66bfbfc8033ebb]), partition=
12:13:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.192201 15662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a59af9fd5a334d8aa532b6997fcb0c67. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:57.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.214406 16911 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Bootstrap starting.
12:13:57.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.216747 16910 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Bootstrap starting.
12:13:57.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.222364 16911 tablet_bootstrap.cc:654] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Neither blocks nor log segments found. Creating new log.
12:13:57.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.222988 16912 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Bootstrap starting.
12:13:57.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.224653 16911 log.cc:826] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Log is configured to *not* fsync() on all Append() calls
12:13:57.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.225198 16910 tablet_bootstrap.cc:654] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Neither blocks nor log segments found. Creating new log.
12:13:57.226 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:57.227 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:57.227 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:57.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.227 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:57.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.228950 16910 log.cc:826] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Log is configured to *not* fsync() on all Append() calls
12:13:57.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.230793 16912 tablet_bootstrap.cc:654] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Neither blocks nor log segments found. Creating new log.
12:13:57.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.231393 16911 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: No bootstrap required, opened a new log
12:13:57.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.231877 16911 ts_tablet_manager.cc:1403] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
12:13:57.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.233222 16912 log.cc:826] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Log is configured to *not* fsync() on all Append() calls
12:13:57.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.242012 16910 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: No bootstrap required, opened a new log
12:13:57.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.242509 16910 ts_tablet_manager.cc:1403] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
12:13:57.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.243865 16912 tablet_bootstrap.cc:492] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: No bootstrap required, opened a new log
12:13:57.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.244340 16912 ts_tablet_manager.cc:1403] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
12:13:57.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:57.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.252022 16911 raft_consensus.cc:359] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.252907 16911 raft_consensus.cc:385] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:57.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.253165 16911 raft_consensus.cc:740] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3c1273c788468592a8a705dc7962d6, State: Initialized, Role: FOLLOWER
12:13:57.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.254079 16911 consensus_queue.cc:260] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.265800 16911 ts_tablet_manager.cc:1434] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Time spent starting tablet: real 0.034s	user 0.021s	sys 0.005s
12:13:57.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.271303 16912 raft_consensus.cc:359] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.272204 16912 raft_consensus.cc:385] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:57.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.272524 16912 raft_consensus.cc:740] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1562194b6164ee6838699499610e490, State: Initialized, Role: FOLLOWER
12:13:57.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.273568 16912 consensus_queue.cc:260] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.277643 16912 ts_tablet_manager.cc:1434] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Time spent starting tablet: real 0.033s	user 0.034s	sys 0.001s
12:13:57.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.281859 16910 raft_consensus.cc:359] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.282792 16910 raft_consensus.cc:385] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:57.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.283085 16910 raft_consensus.cc:740] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43760ea1b3c34d7caa7fd0f4835bd553, State: Initialized, Role: FOLLOWER
12:13:57.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.284186 16910 consensus_queue.cc:260] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.292459 16910 ts_tablet_manager.cc:1434] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Time spent starting tablet: real 0.050s	user 0.033s	sys 0.002s
12:13:57.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.301752 16916 raft_consensus.cc:493] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:57.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.302325 16916 raft_consensus.cc:515] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.305945 16916 leader_election.cc:290] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43760ea1b3c34d7caa7fd0f4835bd553 (127.14.239.66:41305), d1562194b6164ee6838699499610e490 (127.14.239.65:40259)
12:13:57.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.326318 15823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59af9fd5a334d8aa532b6997fcb0c67" candidate_uuid: "6a3c1273c788468592a8a705dc7962d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" is_pre_election: true
12:13:57.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.327207 15823 raft_consensus.cc:2468] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3c1273c788468592a8a705dc7962d6 in term 0.
12:13:57.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.329155 15910 leader_election.cc:304] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43760ea1b3c34d7caa7fd0f4835bd553, 6a3c1273c788468592a8a705dc7962d6; no voters: 
12:13:57.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.330941 16916 raft_consensus.cc:2804] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:57.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.331310 16916 raft_consensus.cc:493] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:57.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.331638 16916 raft_consensus.cc:3060] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 0 FOLLOWER]: Advancing to term 1
12:13:57.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.335837 15682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59af9fd5a334d8aa532b6997fcb0c67" candidate_uuid: "6a3c1273c788468592a8a705dc7962d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1562194b6164ee6838699499610e490" is_pre_election: true
12:13:57.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.336611 15682 raft_consensus.cc:2468] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3c1273c788468592a8a705dc7962d6 in term 0.
12:13:57.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.338440 16916 raft_consensus.cc:515] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.340306 16916 leader_election.cc:290] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [CANDIDATE]: Term 1 election: Requested vote from peers 43760ea1b3c34d7caa7fd0f4835bd553 (127.14.239.66:41305), d1562194b6164ee6838699499610e490 (127.14.239.65:40259)
12:13:57.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.341017 15823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59af9fd5a334d8aa532b6997fcb0c67" candidate_uuid: "6a3c1273c788468592a8a705dc7962d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43760ea1b3c34d7caa7fd0f4835bd553"
12:13:57.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.341519 15823 raft_consensus.cc:3060] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 0 FOLLOWER]: Advancing to term 1
12:13:57.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.341679 15682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a59af9fd5a334d8aa532b6997fcb0c67" candidate_uuid: "6a3c1273c788468592a8a705dc7962d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1562194b6164ee6838699499610e490"
12:13:57.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.342150 15682 raft_consensus.cc:3060] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 0 FOLLOWER]: Advancing to term 1
12:13:57.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.348086 15823 raft_consensus.cc:2468] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3c1273c788468592a8a705dc7962d6 in term 1.
12:13:57.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.348327 15682 raft_consensus.cc:2468] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3c1273c788468592a8a705dc7962d6 in term 1.
12:13:57.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.349637 15910 leader_election.cc:304] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43760ea1b3c34d7caa7fd0f4835bd553, 6a3c1273c788468592a8a705dc7962d6; no voters: 
12:13:57.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.350241 16916 raft_consensus.cc:2804] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 1 FOLLOWER]: Leader election won for term 1
12:13:57.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.351994 16916 raft_consensus.cc:697] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [term 1 LEADER]: Becoming Leader. State: Replica: 6a3c1273c788468592a8a705dc7962d6, State: Running, Role: LEADER
12:13:57.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.352896 16916 consensus_queue.cc:237] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } }
12:13:57.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:57.354079 16027 tablet.cc:2406] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:57.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:57.363930 15735 tablet.cc:2406] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:57.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.365124 15494 catalog_manager.cc:5697] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3c1273c788468592a8a705dc7962d6 (127.14.239.67). New cstate: current_term: 1 leader_uuid: "6a3c1273c788468592a8a705dc7962d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a3c1273c788468592a8a705dc7962d6" member_type: VOTER last_known_addr { host: "127.14.239.67" port: 39483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 } health_report { overall_health: UNKNOWN } } }
12:13:57.386 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:57.386 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:57.386 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:57.386 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.386 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.386 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.386 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.386 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.386 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.386 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.387 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.387 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.387 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:57.484 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:57.485 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:57.485 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:57.485 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:57.485 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:57.485 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:57.485 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:57.485 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:57.485 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:57.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:57.486 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:57.486 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:57.486 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:57.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:57.534155 15875 tablet.cc:2406] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:57.539 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:13:57.542 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a59af9fd5a334d8aa532b6997fcb0c67 for table 'replication_test_table' with partition [<start>, <end>)
12:13:57.543 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a59af9fd5a334d8aa532b6997fcb0c67@[43760ea1b3c34d7caa7fd0f4835bd553(127.14.239.66:41305),6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)[L],d1562194b6164ee6838699499610e490(127.14.239.65:40259)]}]
12:13:57.543 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC GetTableLocations: received response from server master-127.14.239.124:41311: OK, deferred=null) after lookup
12:13:57.543 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] connecting to peer
12:13:57.544 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] Successfully connected to peer
12:13:57.553 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.555 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x506d41ea, L:/127.0.0.1:39358 - R:/127.14.239.67:39483] using TOKEN/null
12:13:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.567803 15682 raft_consensus.cc:1275] T a59af9fd5a334d8aa532b6997fcb0c67 P d1562194b6164ee6838699499610e490 [term 1 FOLLOWER]: Refusing update from remote peer 6a3c1273c788468592a8a705dc7962d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.568105 15823 raft_consensus.cc:1275] T a59af9fd5a334d8aa532b6997fcb0c67 P 43760ea1b3c34d7caa7fd0f4835bd553 [term 1 FOLLOWER]: Refusing update from remote peer 6a3c1273c788468592a8a705dc7962d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:13:57.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.569654 16921 consensus_queue.cc:1048] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1562194b6164ee6838699499610e490" member_type: VOTER last_known_addr { host: "127.14.239.65" port: 40259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:57.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.570865 16921 consensus_queue.cc:1048] T a59af9fd5a334d8aa532b6997fcb0c67 P 6a3c1273c788468592a8a705dc7962d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43760ea1b3c34d7caa7fd0f4835bd553" member_type: VOTER last_known_addr { host: "127.14.239.66" port: 41305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:57.597 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:57.598 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:57.598 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:57.599 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.599 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.599 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.601 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.601 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.601 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.601 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.601 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.601 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.601 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:57.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.603318 16925 mvcc.cc:204] Tried to move back new op lower bound from 7305268582661148672 to 7305268581809434624. Current Snapshot: MvccSnapshot[applied={T|T < 7305268582661148672}]
12:13:57.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:57.704 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:57.704 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:57.705 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:57.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.705 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.706 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.706 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.706 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.706 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.706 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.706 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.706 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:57.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:57.750 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:57.753 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:57.753 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:13:57.754 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:13:57.754 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:13:57.755 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:13:57.758 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:13:57.758 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:13:57.759 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:13:57.762 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:13:57.769 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:13:57.773 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.775 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.778 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.779 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbf6007a2, L:/127.0.0.1:50090 - R:/127.15.167.188:40073] using SASL/PLAIN
12:13:57.779 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd57818e0, L:/127.0.0.1:44504 - R:/127.15.167.189:34023] using SASL/PLAIN
12:13:57.781 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0b20f746, L:/127.0.0.1:36604 - R:/127.15.167.190:46157] using SASL/PLAIN
12:13:57.785 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:57.785 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=31), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [31ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: OK, deferred=null) after lookup
12:13:57.788 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:13:57.789 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:13:57.789 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.239.126:41849(127.14.239.126:41849)] Successfully connected to peer
12:13:57.790 [DEBUG - main] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:13:57.791 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.239.124:41311(127.14.239.124:41311)] Successfully connected to peer
12:13:57.796 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.126
12:13:57.798 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.239.125:46113(127.14.239.125:46113)] Successfully connected to peer
12:13:57.805 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.125
12:13:57.809 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.810 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.124
12:13:57.814 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfebc2fe9, L:/127.0.0.1:39644 - R:/127.14.239.126:41849] using SASL/PLAIN
12:13:57.819 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.819 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:57.821 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7460dde5, L:/127.0.0.1:58352 - R:/127.14.239.124:41311] using SASL/PLAIN
12:13:57.823 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc3ded825, L:/127.0.0.1:43750 - R:/127.14.239.125:46113] using SASL/PLAIN
12:13:57.825 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:57.825 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [32ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: OK, deferred=null) after lookup
12:13:57.828 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:13:57.831 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a59af9fd5a334d8aa532b6997fcb0c67 for table 'replication_test_table' with partition [<start>, <end>)
12:13:57.831 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a59af9fd5a334d8aa532b6997fcb0c67@[43760ea1b3c34d7caa7fd0f4835bd553(127.14.239.66:41305),6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)[L],d1562194b6164ee6838699499610e490(127.14.239.65:40259)]}]
12:13:57.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.833527 16286 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50090:
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:13:57.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:13:57.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:13:57.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:13:57.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:57.841485 16286 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:13:57.862 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:57.863 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:57.863 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:57.863 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.863 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.863 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:57.864 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.864 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.864 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:57.864 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.864 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.864 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:57.864 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:57.904 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:13:57.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:57.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:57.927 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:57.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.928 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.929 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.929 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.929 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.929 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.929 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:57.947 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:57.947 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:57.947 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:57.948 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:57.948 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.949 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.949 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:57.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.949 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:57.949 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:57.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.951061 16620 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 (DEFAULT_TABLE table=replication_test_table [id=873cef40115c49d48756d9332e4ff803]), partition=
12:13:57.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:57.952600 16620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:58.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.002947 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 (DEFAULT_TABLE table=replication_test_table [id=873cef40115c49d48756d9332e4ff803]), partition=
12:13:58.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.000406 16812 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 (DEFAULT_TABLE table=replication_test_table [id=873cef40115c49d48756d9332e4ff803]), partition=
12:13:58.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.004940 16812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:58.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.005348 16877 heartbeater.cc:499] Master 127.15.167.188:40073 was elected leader, sending a full tablet report...
12:13:58.007 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:58.007 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:58.008 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:58.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:58.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:58.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:58.009 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:58.009 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:58.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:58.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:58.009 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:58.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:58.009 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:58.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.004961 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9. 1 dirs total, 0 dirs full, 0 dirs failed
12:13:58.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.018169 16968 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Bootstrap starting.
12:13:58.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.025426 16968 tablet_bootstrap.cc:654] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Neither blocks nor log segments found. Creating new log.
12:13:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.027770 16968 log.cc:826] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Log is configured to *not* fsync() on all Append() calls
12:13:58.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.039182 16968 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: No bootstrap required, opened a new log
12:13:58.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.039723 16968 ts_tablet_manager.cc:1403] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
12:13:58.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.051831 16970 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Bootstrap starting.
12:13:58.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.063899 16971 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Bootstrap starting.
12:13:58.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.067418 16968 raft_consensus.cc:359] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.068360 16968 raft_consensus.cc:385] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:58.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.068642 16968 raft_consensus.cc:740] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fae72a698ae8488684c64de402139058, State: Initialized, Role: FOLLOWER
12:13:58.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.069552 16968 consensus_queue.cc:260] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.074683 16970 tablet_bootstrap.cc:654] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Neither blocks nor log segments found. Creating new log.
12:13:58.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.080646 16971 tablet_bootstrap.cc:654] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Neither blocks nor log segments found. Creating new log.
12:13:58.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.081760 16970 log.cc:826] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Log is configured to *not* fsync() on all Append() calls
12:13:58.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.083209 16968 ts_tablet_manager.cc:1434] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Time spent starting tablet: real 0.043s	user 0.019s	sys 0.019s
12:13:58.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.118163 16971 log.cc:826] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Log is configured to *not* fsync() on all Append() calls
12:13:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.127307 16970 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: No bootstrap required, opened a new log
12:13:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.127332 16971 tablet_bootstrap.cc:492] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: No bootstrap required, opened a new log
12:13:58.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.127827 16970 ts_tablet_manager.cc:1403] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.009s
12:13:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.129479 16971 ts_tablet_manager.cc:1403] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
12:13:58.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.154680 16970 raft_consensus.cc:359] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.155651 16970 raft_consensus.cc:385] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.155959 16970 raft_consensus.cc:740] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6281af7c1bc4e3d9e516eac6adeaf1f, State: Initialized, Role: FOLLOWER
12:13:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.156989 16970 consensus_queue.cc:260] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.167048 16970 ts_tablet_manager.cc:1434] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Time spent starting tablet: real 0.039s	user 0.033s	sys 0.005s
12:13:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.169108 16971 raft_consensus.cc:359] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.170200 16971 raft_consensus.cc:385] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:13:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.170670 16971 raft_consensus.cc:740] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 730600ff807a48c88c8abc8aab572a15, State: Initialized, Role: FOLLOWER
12:13:58.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.171769 16971 consensus_queue.cc:260] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.179020 16975 raft_consensus.cc:493] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:58.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.179673 16975 raft_consensus.cc:515] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.183257 16975 leader_election.cc:290] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fae72a698ae8488684c64de402139058 (127.15.167.130:34817), 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:58.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:58.194510 16694 tablet.cc:2406] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:58.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.200953 16971 ts_tablet_manager.cc:1434] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Time spent starting tablet: real 0.071s	user 0.025s	sys 0.011s
12:13:58.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.201112 16972 raft_consensus.cc:493] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:13:58.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.201633 16972 raft_consensus.cc:515] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.210533 16972 leader_election.cc:290] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6281af7c1bc4e3d9e516eac6adeaf1f (127.15.167.129:41401), 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:58.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.216444 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fae72a698ae8488684c64de402139058" is_pre_election: true
12:13:58.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.217212 16640 raft_consensus.cc:2468] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6281af7c1bc4e3d9e516eac6adeaf1f in term 0.
12:13:58.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.218915 16414 leader_election.cc:304] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6281af7c1bc4e3d9e516eac6adeaf1f, fae72a698ae8488684c64de402139058; no voters: 
12:13:58.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.219883 16977 raft_consensus.cc:2804] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Leader pre-election won for term 1
12:13:58.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.220268 16977 raft_consensus.cc:493] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:13:58.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.220594 16977 raft_consensus.cc:3060] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 0 FOLLOWER]: Advancing to term 1
12:13:58.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:58.226610 16880 tablet.cc:2406] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:58.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.226724 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "fae72a698ae8488684c64de402139058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" is_pre_election: true
12:13:58.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.228374 16977 raft_consensus.cc:515] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.229597 16480 raft_consensus.cc:2393] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fae72a698ae8488684c64de402139058 in current term 1: Already voted for candidate b6281af7c1bc4e3d9e516eac6adeaf1f in this term.
12:13:58.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.231140 16640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fae72a698ae8488684c64de402139058"
12:13:58.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.231665 16640 raft_consensus.cc:3060] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 0 FOLLOWER]: Advancing to term 1
12:13:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.235992 16832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "730600ff807a48c88c8abc8aab572a15" is_pre_election: true
12:13:58.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.236543 16977 leader_election.cc:290] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [CANDIDATE]: Term 1 election: Requested vote from peers fae72a698ae8488684c64de402139058 (127.15.167.130:34817), 730600ff807a48c88c8abc8aab572a15 (127.15.167.131:35147)
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.236891 16831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "fae72a698ae8488684c64de402139058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "730600ff807a48c88c8abc8aab572a15" is_pre_election: true
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.237114 16832 raft_consensus.cc:2468] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6281af7c1bc4e3d9e516eac6adeaf1f in term 0.
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.238637 16830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf1bdd4a8d74817b32cd38fd3ee73f9" candidate_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "730600ff807a48c88c8abc8aab572a15"
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.239198 16830 raft_consensus.cc:3060] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 0 FOLLOWER]: Advancing to term 1
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.240278 16640 raft_consensus.cc:2468] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6281af7c1bc4e3d9e516eac6adeaf1f in term 1.
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.242401 16576 leader_election.cc:304] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fae72a698ae8488684c64de402139058; no voters: 730600ff807a48c88c8abc8aab572a15, b6281af7c1bc4e3d9e516eac6adeaf1f
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.243242 16972 raft_consensus.cc:2749] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P fae72a698ae8488684c64de402139058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:13:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.244091 16414 leader_election.cc:304] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6281af7c1bc4e3d9e516eac6adeaf1f, fae72a698ae8488684c64de402139058; no voters: 
12:13:58.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.244933 16977 raft_consensus.cc:2804] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 1 FOLLOWER]: Leader election won for term 1
12:13:58.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.245873 16977 raft_consensus.cc:697] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [term 1 LEADER]: Becoming Leader. State: Replica: b6281af7c1bc4e3d9e516eac6adeaf1f, State: Running, Role: LEADER
12:13:58.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.248307 16830 raft_consensus.cc:2468] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P 730600ff807a48c88c8abc8aab572a15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6281af7c1bc4e3d9e516eac6adeaf1f in term 1.
12:13:58.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:58.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.248343 16977 consensus_queue.cc:237] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } }
12:13:58.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.258837 16286 catalog_manager.cc:5697] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f reported cstate change: term changed from 0 to 1, leader changed from <none> to b6281af7c1bc4e3d9e516eac6adeaf1f (127.15.167.129). New cstate: current_term: 1 leader_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6281af7c1bc4e3d9e516eac6adeaf1f" member_type: VOTER last_known_addr { host: "127.15.167.129" port: 41401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 } health_report { overall_health: UNKNOWN } } }
12:13:58.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:13:58.394488 16534 tablet.cc:2406] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:13:58.563 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:58.563 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:58.564 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:58.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:58.564 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:58.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:58.564 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:58.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:58.564 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:58.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:58.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:58.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:58.564 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:58.596 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state READY
12:13:58.596 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state READY
12:13:58.597 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state READY
12:13:58.597 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:58.597 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.239.126:41849(127.14.239.126:41849)] handling channelInactive
12:13:58.597 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state READY due to: connection closed
12:13:58.597 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.239.124:41311(127.14.239.124:41311)] handling channelInactive
12:13:58.598 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state READY due to: connection closed
12:13:58.598 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:13:58.598 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:13:58.599 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.239.125:46113(127.14.239.125:46113)] handling channelInactive
12:13:58.599 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state READY due to: connection closed
12:13:58.599 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state READY
12:13:58.599 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state READY
12:13:58.600 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:13:58.600 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state READY
12:13:58.600 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:13:58.600 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:13:58.600 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:13:58.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:13:58.601 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:13:58.602 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:13:58.602 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:13:58.603 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:13:58.603 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:13:58.603 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
12:13:58.605 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:58.605 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:13:58.605 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:13:58.605 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:58.606 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:58.606 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:13:58.620 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:13:58.620 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:13:58.624 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:13:58.624 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:13:58.624 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:13:58.624 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:58.624 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:58.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:13:58.625 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:58.625 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:58.625 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:13:58.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:58.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:58.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:13:58.625 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:13:58.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:58.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:58.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.755738 16977 consensus_queue.cc:1048] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fae72a698ae8488684c64de402139058" member_type: VOTER last_known_addr { host: "127.15.167.130" port: 34817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:58.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:13:58.787726 16996 consensus_queue.cc:1048] T 6bf1bdd4a8d74817b32cd38fd3ee73f9 P b6281af7c1bc4e3d9e516eac6adeaf1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "730600ff807a48c88c8abc8aab572a15" member_type: VOTER last_known_addr { host: "127.15.167.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:13:58.837 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:13:58.902 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:13:58.902 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:13:58.902 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:13:58.915 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:13:58.915 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:13:58.915 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:13:58.916 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:58.916 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:58.916 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:13:58.916 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:13:58.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:58.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:58.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:13:58.917 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:58.917 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:58.917 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:13:58.917 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:13:59.111 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:13:59.112 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:13:59.112 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:13:59.112 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:59.112 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:59.112 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:13:59.112 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:59.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:59.113 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:13:59.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:59.113 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:59.113 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:13:59.113 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:13:59.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:59.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:59.326 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:59.327 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:59.327 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:59.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.328 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.328 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:59.345 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:59.345 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:59.345 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:59.346 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.346 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.346 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.347 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.347 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.347 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.347 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.347 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.347 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.347 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:59.464 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:59.464 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:59.465 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.466 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.466 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:59.466 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.467 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.467 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.467 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.467 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:59.549 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:13:59.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:59.675 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:13:59.688 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:13:59.710 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:13:59.719 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:13:59.732 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:13:59.738 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:13:59.739 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:13:59.739 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:13:59.739 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:13:59.740 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:13:59.740 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:13:59.740 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:13:59.740 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:13:59.741 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:13:59.741 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:13:59.741 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:13:59.741 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:13:59.741 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:13:59.741 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:13:59.742 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:13:59.742 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:13:59.742 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:13:59.742 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:13:59.742 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:13:59.742 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_fecb9b340068b62db8b6741e5a110c1f/blobStorage
12:13:59.743 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:39737 - max concurrent requests: 50 - max backlog: 1000
12:13:59.743 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_fecb9b340068b62db8b6741e5a110c1f/blobStorage
12:13:59.744 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_fecb9b340068b62db8b6741e5a110c1f/blobStorage
12:13:59.745 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:13:59.746 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 0636c56a-84c2-49f6-b548-9c4dd9d18a33
12:13:59.748 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:13:59.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:13:59.748 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-f01eced7-ec2b-45b1-aa67-10878f5fb794
12:13:59.750 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-16848074-8643-43bf-b23e-cb7d2c619359
12:13:59.811 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:13:59.811 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:13:59.811 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:13:59.811 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:13:59.812 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:13:59.816 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_8 .
12:13:59.824 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
12:13:59.824 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-f3545a45-a781-4385-aafd-49d87193f3c9
12:13:59.824 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:13:59.825 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:13:59.833 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:13:59.833 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:13:59.841 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37539
12:13:59.841 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:13:59.854 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:13:59.855 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37539 was granted leadership with leaderSessionID=fa09a01b-10aa-4a5e-8b95-06959228a632
12:13:59.855 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37539 , session=fa09a01b-10aa-4a5e-8b95-06959228a632
12:13:59.855 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:13:59.855 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:13:59.855 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 05c9b778-5143-4897-b2a4-d6e296be1460. Creating new DispatcherLeaderProcess.
12:13:59.855 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:13:59.856 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:13:59.856 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:13:59.857 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:13:59.858 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_9 .
12:13:59.865 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_9 , session=05c9b778-5143-4897-b2a4-d6e296be1460
12:13:59.869 [INFO - pool-119-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id cda49e0d-cc89-4986-829b-7573821d05aa.
12:13:59.880 [INFO - pool-119-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_10 .
12:13:59.886 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:13:59.886 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:13:59.886 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:13:59.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.887 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.887 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.887 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.887 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:13:59.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:13:59.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:13:59.887 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:13:59.889 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
12:13:59.889 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:13:59.889 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:13:59.889 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:13:59.890 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:13:59.890 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_10 , session=cda49e0d-cc89-4986-829b-7573821d05aa
12:13:59.898 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(829b7573821d05aacda49e0dcc894986).
12:13:59.906 [INFO - flink-pekko.actor.default-dispatcher-6] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:13:59.910 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (c0988648dfcd43275159a42b4d64d13e).
12:13:59.911 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (c0988648dfcd43275159a42b4d64d13e).
12:13:59.911 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-c0988648dfcd43275159a42b4d64d13e'.
12:13:59.911 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job c0988648dfcd43275159a42b4d64d13e was granted leadership with leader id 93c60d69-5dd3-49c5-8591-1bf384a116ad. Creating new JobMasterServiceProcess.
12:13:59.912 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1080) Registering TaskManager with ResourceID 0636c56a-84c2-49f6-b548-9c4dd9d18a33 (pekko://flink/user/rpc/taskmanager_8) at ResourceManager
12:13:59.912 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_10 under registration id e94d3ec24517abef5a2a0e2e8d679316.
12:13:59.918 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:344) Registering task executor 0636c56a-84c2-49f6-b548-9c4dd9d18a33 under e94d3ec24517abef5a2a0e2e8d679316 at the slot manager.
12:13:59.922 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_11 .
12:13:59.926 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (c0988648dfcd43275159a42b4d64d13e).
12:13:59.926 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e).
12:13:59.927 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 4349378217306c7802066ab5ba0876c7 for job c0988648dfcd43275159a42b4d64d13e.
12:13:59.927 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e).
12:13:59.927 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:13:59.928 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:13:59.928 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c53d0f4
12:13:59.928 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:13:59.928 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:13:59.929 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:13:59.930 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@53f9a204 for Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e).
12:13:59.930 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_11 , session=93c60d69-5dd3-49c5-8591-1bf384a116ad
12:13:59.931 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (c0988648dfcd43275159a42b4d64d13e) under job master id 85911bf384a116ad93c60d695dd349c5.
12:13:59.931 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:13:59.933 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:13:59.933 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:13:59.933 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state CREATED to RUNNING.
12:13:59.934 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:13:59.934 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:13:59.935 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:13:59.935 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:13:59.935 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:13:59.935 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:13:59.936 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_10(829b7573821d05aacda49e0dcc894986)
12:13:59.936 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.14.239.126:41849(127.14.239.126:41849)] Successfully connected to peer
12:13:59.937 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:13:59.941 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:13:59.941 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:390) Registering job manager 85911bf384a116ad93c60d695dd349c5@pekko://flink/user/rpc/jobmanager_11 for job c0988648dfcd43275159a42b4d64d13e.
12:13:59.946 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.14.239.124:41311(127.14.239.124:41311)] Successfully connected to peer
12:13:59.952 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.14.239.125:46113(127.14.239.125:46113)] Successfully connected to peer
12:13:59.952 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager 85911bf384a116ad93c60d695dd349c5@pekko://flink/user/rpc/jobmanager_11 for job c0988648dfcd43275159a42b4d64d13e.
12:13:59.958 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.124
12:13:59.961 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 829b7573821d05aacda49e0dcc894986.
12:13:59.961 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:13:59.972 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.125
12:13:59.972 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.126
12:13:59.973 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:59.980 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:59.983 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job c0988648dfcd43275159a42b4d64d13e
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 0636c56a-84c2-49f6-b548-9c4dd9d18a33
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:13:59.983 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8cb90538, L:/127.0.0.1:59592 - R:/127.14.239.126:41849] using SASL/PLAIN
12:13:59.984 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 696fbe6e4ee9274ca74773cf22d8f177 from 0636c56a-84c2-49f6-b548-9c4dd9d18a33 for job c0988648dfcd43275159a42b4d64d13e with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:59.985 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 8fd498007e1e3ac575db3c4595d76811 from 0636c56a-84c2-49f6-b548-9c4dd9d18a33 for job c0988648dfcd43275159a42b4d64d13e with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:59.986 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 9dafe0e73863499223c1fe58bd6fdace from 0636c56a-84c2-49f6-b548-9c4dd9d18a33 for job c0988648dfcd43275159a42b4d64d13e with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:59.986 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 0ed654e7eea26cf337f9e106a0b49044 from 0636c56a-84c2-49f6-b548-9c4dd9d18a33 for job c0988648dfcd43275159a42b4d64d13e with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:59.987 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 696fbe6e4ee9274ca74773cf22d8f177 for job c0988648dfcd43275159a42b4d64d13e from resource manager with leader id 829b7573821d05aacda49e0dcc894986.
12:13:59.988 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 696fbe6e4ee9274ca74773cf22d8f177 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:13:59.992 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc8d14ad2, L:/127.0.0.1:50038 - R:/127.14.239.124:41311] using SASL/PLAIN
12:13:59.994 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:13:59.997 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:13:59.997 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:13:59.997 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=63), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [54ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: OK, deferred=null) after lookup
12:14:00.000 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:14:00.004 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7b1505e4, L:/127.0.0.1:45474 - R:/127.14.239.125:46113] using SASL/PLAIN
12:14:00.006 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a59af9fd5a334d8aa532b6997fcb0c67 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.006 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a59af9fd5a334d8aa532b6997fcb0c67@[43760ea1b3c34d7caa7fd0f4835bd553(127.14.239.66:41305),6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)[L],d1562194b6164ee6838699499610e490(127.14.239.65:40259)]}]
12:14:00.009 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job c0988648dfcd43275159a42b4d64d13e for job leader monitoring.
12:14:00.009 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 8fd498007e1e3ac575db3c4595d76811 for job c0988648dfcd43275159a42b4d64d13e from resource manager with leader id 829b7573821d05aacda49e0dcc894986.
12:14:00.009 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 8fd498007e1e3ac575db3c4595d76811 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:00.010 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 9dafe0e73863499223c1fe58bd6fdace for job c0988648dfcd43275159a42b4d64d13e from resource manager with leader id 829b7573821d05aacda49e0dcc894986.
12:14:00.010 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 9dafe0e73863499223c1fe58bd6fdace with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:00.010 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 0ed654e7eea26cf337f9e106a0b49044 for job c0988648dfcd43275159a42b4d64d13e from resource manager with leader id 829b7573821d05aacda49e0dcc894986.
12:14:00.010 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 0ed654e7eea26cf337f9e106a0b49044 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:00.011 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_11 with leader id 93c60d69-5dd3-49c5-8591-1bf384a116ad.
12:14:00.013 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:14:00.013 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:00.014 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_11 for job c0988648dfcd43275159a42b4d64d13e.
12:14:00.015 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1783) Establish JobManager connection for job c0988648dfcd43275159a42b4d64d13e.
12:14:00.015 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1633) Offer reserved slots to the leader of job c0988648dfcd43275159a42b4d64d13e.
12:14:00.016 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:14:00.016 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:14:00.016 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:14:00.017 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job c0988648dfcd43275159a42b4d64d13e.
12:14:00.017 [INFO - flink-pekko.actor.default-dispatcher-4] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:14:00.017 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id c0988648dfcd43275159a42b4d64d13e
12:14:00.018 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:14:00.020 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:14:00.021 [DEBUG - main] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:00.021 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:14:00.033 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:14:00.035 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:14:00.035 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:14:00.035 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:14:00.036 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@fc25570
12:14:00.036 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:00.036 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:00.036 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:14:00.040 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@703213cc
12:14:00.042 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:00.051 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.054 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc65cb432, L:/127.0.0.1:48216 - R:/127.15.167.188:40073] using SASL/PLAIN
12:14:00.055 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:14:00.055 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:14:00.056 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:14:00.057 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:14:00.059 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:00.059 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=85), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, deferred=null) after lookup
12:14:00.062 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.064 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:14:00.065 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:14:00.065 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:14:00.068 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:14:00.071 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.071 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.072 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=8), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.167.188:40073, [8ms] Sub RPC GetTableLocations: received response from server master-127.15.167.188:40073: OK, deferred=null)) after lookup
12:14:00.072 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] connecting to peer
12:14:00.076 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.078 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.078 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x87aa7e2b, L:/127.0.0.1:60766 - R:/127.15.167.189:34023] using SASL/PLAIN
12:14:00.085 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9c350ffd, L:/127.0.0.1:46318 - R:/127.15.167.190:46157] using SASL/PLAIN
12:14:00.089 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:14:00.090 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:14:00.094 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:14:00.094 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:14:00.095 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@40e176cb
12:14:00.095 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:00.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:00.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:14:00.107 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@f33a288
12:14:00.109 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:00.111 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:14:00.111 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:14:00.111 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7711351
12:14:00.111 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:00.112 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:00.112 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:14:00.117 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:14:00.117 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:14:00.118 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:14:00.118 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:14:00.118 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:14:00.118 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:14:00.119 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:14:00.122 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] Successfully connected to peer
12:14:00.133 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cdb99c0
12:14:00.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:00.144 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:00.145 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:00.145 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:14:00.145 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:14:00.145 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:14:00.145 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:14:00.146 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:14:00.146 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:14:00.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37eb6761
12:14:00.147 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:00.149 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:00.149 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:14:00.150 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:14:00.154 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.155 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:00.159 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe7799b1d, L:/127.0.0.1:54488 - R:/127.15.167.129:41401] using TOKEN/null
12:14:00.161 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:00.164 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5f9918ce
12:14:00.168 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:00.169 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:14:00.173 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:14:00.174 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:00.178 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:00.179 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:14:00.185 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:14:00.190 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:14:00.193 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:00.193 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:14:00.195 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:14:00.199 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:00.200 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.200 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.201 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:14:00.205 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa441800c, L:/127.0.0.1:46320 - R:/127.15.167.190:46157] using SASL/PLAIN
12:14:00.205 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.208 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:14:00.210 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:00.211 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:14:00.221 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa1d9326b, L:/127.0.0.1:48222 - R:/127.15.167.188:40073] using SASL/PLAIN
12:14:00.222 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.222 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.223 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:00.225 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5c1adbde, L:/127.0.0.1:60772 - R:/127.15.167.189:34023] using SASL/PLAIN
12:14:00.225 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:14:00.226 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:14:00.227 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:14:00.230 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:00.235 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:14:00.244 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:14:00.245 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf8fd8cd7, L:/127.0.0.1:46322 - R:/127.15.167.190:46157] using SASL/PLAIN
12:14:00.249 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:00.250 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.167.190:46157(127.15.167.190:46157)] Successfully connected to peer
12:14:00.250 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.254 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:00.255 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.167.188:40073(127.15.167.188:40073)] Successfully connected to peer
12:14:00.256 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:00.258 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.265 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.167.189:34023(127.15.167.189:34023)] Successfully connected to peer
12:14:00.271 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:14:00.269 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.275 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1e885615, L:/127.0.0.1:48228 - R:/127.15.167.188:40073] using SASL/PLAIN
12:14:00.278 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xde5c04c8, L:/127.0.0.1:60776 - R:/127.15.167.189:34023] using SASL/PLAIN
12:14:00.288 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:14:00.294 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.296 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.189
12:14:00.301 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:14:00.308 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:00.308 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=198), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [67ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: OK, [160ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: OK, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, deferred=null) after lookup
12:14:00.309 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:00.310 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=266), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, deferred=null) after lookup
12:14:00.313 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.313 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa9c3ace3, L:/127.0.0.1:46328 - R:/127.15.167.190:46157] using SASL/PLAIN
12:14:00.318 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.321 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.188
12:14:00.325 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x4ff3f180, L:/127.0.0.1:60780 - R:/127.15.167.189:34023] using SASL/PLAIN
12:14:00.328 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.331 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.343 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x1b37f978, L:/127.0.0.1:48232 - R:/127.15.167.188:40073] using SASL/PLAIN
12:14:00.350 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.167.190
12:14:00.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.353 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.355 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xbe162c45, L:/127.0.0.1:60788 - R:/127.15.167.189:34023] using SASL/PLAIN
12:14:00.359 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.360 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48ed715b
12:14:00.362 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:00.362 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=207), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, deferred=null) after lookup
12:14:00.373 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.373 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@732895fb
12:14:00.374 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.364 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:14:00.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:14:00.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:14:00.375 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:14:00.375 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.377 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.380 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.380 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d0f5b6c
12:14:00.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:14:00.382 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:14:00.389 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.392 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0e9b20d0, L:/127.0.0.1:48242 - R:/127.15.167.188:40073] using SASL/PLAIN
12:14:00.392 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:00.396 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:00.396 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=221), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [109ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: OK, [138ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: OK, [165ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: OK, deferred=null) after lookup
12:14:00.398 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:14:00.398 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a889a36753ca8fc59784dd5fd74bc965256e56fa300a07642c192b0a47d31431'}]
12:14:00.399 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.400 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:00.403 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:00.403 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@825f383
12:14:00.405 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2fd75e02, L:/127.0.0.1:46324 - R:/127.15.167.190:46157] using SASL/PLAIN
12:14:00.408 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:00.409 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=a59af9fd5a334d8aa532b6997fcb0c67@[43760ea1b3c34d7caa7fd0f4835bd553(127.14.239.66:41305),6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483),d1562194b6164ee6838699499610e490(127.14.239.65:40259)[L]]}]
12:14:00.433 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:14:00.435 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:14:00.436 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] connecting to peer
12:14:00.437 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:14:00.438 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:14:00.439 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:14:00.439 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:14:00.440 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:14:00.446 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.446 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] Successfully connected to peer
12:14:00.447 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:14:00.449 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:14:00.459 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.67
12:14:00.470 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.476 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd33b0dde, L:/127.0.0.1:42260 - R:/127.14.239.67:39483] using SASL/PLAIN
12:14:00.503 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.537 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305268592369664001) for scanner KuduScanner(table=replication_test_table, tablet=a59af9fd5a334d8aa532b6997fcb0c67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.539 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [a889a36753ca8fc59784dd5fd74bc965256e56fa300a07642c192b0a47d31431]
12:14:00.540 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:14:00.544 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a889a36753ca8fc59784dd5fd74bc965256e56fa300a07642c192b0a47d31431]
12:14:00.547 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a889a36753ca8fc59784dd5fd74bc965256e56fa300a07642c192b0a47d31431 finished by subtask 1; deferring removal (restored in pending)
12:14:00.549 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.549 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.556 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:00.556 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:00.556 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] disconnecting while in state READY
12:14:00.557 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:00.559 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.564 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.564 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.572 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.573 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.573 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.573 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.574 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.574 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.574 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.574 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.575 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.575 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.575 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6bf1bdd4a8d74817b32cd38fd3ee73f9 for table 'replication_test_table' with partition [<start>, <end>)
12:14:00.575 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9@[730600ff807a48c88c8abc8aab572a15(127.15.167.131:35147),b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)[L],fae72a698ae8488684c64de402139058(127.15.167.130:34817)]}]
12:14:00.576 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] handling channelInactive
12:14:00.576 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] cleaning up while in state READY due to: connection closed
12:14:00.576 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:14:00.576 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:00.617 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:00.644 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:00.644 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:00.644 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:00.645 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:00.645 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:00.645 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:00.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:00.646 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:00.646 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:00.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:00.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:00.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:00.646 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:00.676 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.676 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:00.677 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:00.677 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:00.678 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:00.678 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:00.678 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:00.678 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:00.678 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:00.678 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:00.679 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:00.679 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:00.679 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:00.679 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:00.735 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:00.795 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.852 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512840892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:00.895 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=504, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@5431c0a3, flushNotification=Deferred@866419580(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:14:00.896 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] connecting to peer
12:14:00.900 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] Successfully connected to peer
12:14:00.913 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:00.927 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:00.929 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xd1ecaf10, L:/127.0.0.1:54500 - R:/127.15.167.129:41401] using TOKEN/null
12:14:00.969 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.003 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:01.003 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:01.003 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:01.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.005 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.005 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.005 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.005 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.005 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.005 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:01.026 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.065 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:01.065 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:01.065 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:01.066 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:01.066 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:01.066 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:01.066 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:01.066 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:01.066 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:01.067 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:01.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:01.067 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:01.067 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:01.079 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job c0988648dfcd43275159a42b4d64d13e (1584 bytes, checkpointDuration=187 ms, finalizationTime=0 ms).
12:14:01.081 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:14:01.081 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a889a36753ca8fc59784dd5fd74bc965256e56fa300a07642c192b0a47d31431 from pending
12:14:01.081 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
12:14:01.085 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.089 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:14:01.093 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:01.099 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:14:01.102 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:01.106 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:14:01.108 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:01.108 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:01.108 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:01.108 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.108 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.108 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.109 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.109 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.109 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.109 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 873cef40115c49d48756d9332e4ff803
12:14:01.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.110 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:01.121 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a59af9fd5a334d8aa532b6997fcb0c67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.131 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:01.151 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a59af9fd5a334d8aa532b6997fcb0c67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.170 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6bf1bdd4a8d74817b32cd38fd3ee73f9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.171 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state READY
12:14:01.171 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state READY
12:14:01.171 [DEBUG - main] (Connection.java:575) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] disconnecting while in state READY
12:14:01.171 [DEBUG - main] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state READY
12:14:01.172 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:14:01.172 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:14:01.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:14:01.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:14:01.173 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] handling channelInactive
12:14:01.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] cleaning up while in state READY due to: connection closed
12:14:01.173 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:01.174 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:01.174 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:14:01.174 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
12:14:01.180 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:14:01.180 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:14:01.181 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
12:14:01.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.181483 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16377
12:14:01.212 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] handling channelInactive
12:14:01.212 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] cleaning up while in state READY due to: connection closed
12:14:01.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.214768 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16529
12:14:01.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.248099 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16695
12:14:01.250 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.272758 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16042
12:14:01.303 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:14:01.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:14:01.303 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:14:01.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:14:01.303 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:14:01.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:14:01.305 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.167.190:46157(127.15.167.190:46157)] handling channelInactive
12:14:01.305 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state READY due to: connection closed
12:14:01.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.306196 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16167
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:14:01.373 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:14:01.383 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.167.189:34023(127.15.167.189:34023)] handling channelInactive
12:14:01.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state READY due to: connection closed
12:14:01.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:01.383541 16274 connection.cc:573] client connection to 127.15.167.189:34023 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:01.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:01.383993 16274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:01.391008 16030 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 16243
12:14:01.399 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512841392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:01.409 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:14:01.410 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:14:01.427 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:14:01.428 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.167.188:40073(127.15.167.188:40073)] handling channelInactive
12:14:01.428 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state READY due to: connection closed
12:14:01.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:01.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:01.843 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:01.844 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:01.844 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:01.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:01.845 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.845 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:01.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:01.846 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:01.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512841892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:01.906 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:01.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:14:01.926 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:01.926 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:01.926 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:01.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.928 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.928 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.928 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.928 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.928 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.928 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:01.938 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 1adc360b8e5b4cbdbc66bfbfc8033ebb
12:14:01.941 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4a0646ca89161f6b7bc6ccb59b8a15c441072c910e82121c9cd52b3878a27e7d'}]
12:14:01.943 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:01.943 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:01.944 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:01.944 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:01.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:01.944 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.944 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:01.945 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:01.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:01.951 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:01.952 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298065, tablet=a59af9fd5a334d8aa532b6997fcb0c67@[43760ea1b3c34d7caa7fd0f4835bd553(127.14.239.66:41305),6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483),d1562194b6164ee6838699499610e490(127.14.239.65:40259)[L]]}]
12:14:01.953 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] connecting to peer
12:14:01.955 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] Successfully connected to peer
12:14:01.966 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.14.239.67
12:14:01.978 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:01.981 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x734d3348, L:/127.0.0.1:42276 - R:/127.14.239.67:39483] using SASL/PLAIN
12:14:01.995 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268600557568001) for scanner KuduScanner(table=replication_test_table, tablet=a59af9fd5a334d8aa532b6997fcb0c67, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:01.996 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [4a0646ca89161f6b7bc6ccb59b8a15c441072c910e82121c9cd52b3878a27e7d]
12:14:01.996 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4a0646ca89161f6b7bc6ccb59b8a15c441072c910e82121c9cd52b3878a27e7d]
12:14:01.996 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:01.996 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:01.997 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] disconnecting while in state READY
12:14:01.997 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4a0646ca89161f6b7bc6ccb59b8a15c441072c910e82121c9cd52b3878a27e7d finished by subtask 0; deferring removal (restored in pending)
12:14:01.998 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:02.025 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] handling channelInactive
12:14:02.025 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] cleaning up while in state READY due to: connection closed
12:14:02.025 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:14:02.025 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:02.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:02.224 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:02.225 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:02.225 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:02.226 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:02.226 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:02.226 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:02.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:02.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:02.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:02.227 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:02.227 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:02.227 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:02.227 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:02.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:02.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512842392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:02.406 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job c0988648dfcd43275159a42b4d64d13e (1594 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:14:02.408 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:14:02.408 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 4a0646ca89161f6b7bc6ccb59b8a15c441072c910e82121c9cd52b3878a27e7d from pending
12:14:02.408 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
12:14:02.484 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:02.484 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:02.484 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:02.484 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.485 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.485 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.486 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:02.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:02Z chronyd exiting
12:14:02.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:02.686 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:02.686 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:02.686 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:02.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:02.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:02.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:02.687 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:02.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:02.754 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:02.755 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:02.755 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:02.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:02.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:02.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:02.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:02.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:02.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:02.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:02.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:02.755 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:02.755 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:02.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512842892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:02.902 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:02.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:14:03.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:03.170 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:03.171 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:03.171 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:03.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:03.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:03.171 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:03.171 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:03.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:03.171 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:03.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:03.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:03.172 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:03.172 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:03.186 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:03.186 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:03.187 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:03.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.187 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.187 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.187 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.187 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.187 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.187 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.187 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.187 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.187 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:03.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:03.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512843392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:03.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:03.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:14:03.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:03.665 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state READY
12:14:03.665 [DEBUG - main] (Connection.java:575) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] disconnecting while in state READY
12:14:03.665 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state READY
12:14:03.666 [DEBUG - main] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state READY
12:14:03.666 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.239.124:41311(127.14.239.124:41311)] handling channelInactive
12:14:03.666 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] handling channelInactive
12:14:03.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6a3c1273c788468592a8a705dc7962d6(127.14.239.67:39483)] cleaning up while in state READY due to: connection closed
12:14:03.666 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.239.126:41849(127.14.239.126:41849)] handling channelInactive
12:14:03.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state READY due to: connection closed
12:14:03.667 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:03.668 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:03.668 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-3
12:14:03.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state READY due to: connection closed
12:14:03.669 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:14:03.671 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.239.125:46113(127.14.239.125:46113)] handling channelInactive
12:14:03.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state READY due to: connection closed
12:14:03.671 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:14:03.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.672351 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15590
12:14:03.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.715358 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15734
12:14:03.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.747148 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15878
12:14:03.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:03.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.777788 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15305
12:14:03.785 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:03.785 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:03.786 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:03.786 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.786 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.786 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:03.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:03.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:03.786 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:03.804 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.14.239.126:41849(127.14.239.126:41849)] handling channelInactive
12:14:03.804 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state READY due to: connection closed
12:14:03.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.804785 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15375
12:14:03.830 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.14.239.125:46113(127.14.239.125:46113)] handling channelInactive
12:14:03.830 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state READY due to: connection closed
12:14:03.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:03.830515 15293 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 15451
12:14:03.854 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.14.239.124:41311(127.14.239.124:41311)] handling channelInactive
12:14:03.854 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state READY due to: connection closed
12:14:03.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512843892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:03.901 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:03.901 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:14:03.934 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:03.935 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.935 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.935 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.14.239.124:41311(127.14.239.124:41311) for tablet Kudu Master: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.955 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:03.957 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:03.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.957 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:03.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.958 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.958 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.958 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.958 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:03.975 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:03.975 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:03.976 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:03.976 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.977 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:03.995 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:03.996 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:03.996 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:03.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.996 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.996 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.996 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:03.996 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.996 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:03.996 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:03.996 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.015 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.016 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.016 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.016 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.016 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.016 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.016 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.016 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.016 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.016 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.016 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.035 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.036 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.036 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.036 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.036 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.036 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.037 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.037 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.037 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.037 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.055 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.055 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.056 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.056 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.056 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.056 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.087 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:04.088 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:04.088 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:04.088 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.088 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.088 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.088 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.089 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.089 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.089 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:04.094 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.095 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.095 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.096 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:04.235 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.236 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.236 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.236 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.236 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.236 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.236 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.237 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.237 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:04.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:04.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:04.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:04.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.316 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:04.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:04.316 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:04.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:04.316 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:04.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:04.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:04.317 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:04.317 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:04.316 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.317 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.317 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:04.317 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:04.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512844392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:04.401 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:04.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:14:04.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:04.664 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:04.664 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:04.664 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:04.665 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:04.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:04.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:04.665 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:04.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:04.665 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:04.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:04.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:04.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:04.665 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:04.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:04.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:04Z chronyd exiting
12:14:04.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512844892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:04.901 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:04.901 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:14:05.104 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:05.104 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:05.105 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:05.105 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.105 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.105 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.105 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:05.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:05.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:05.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:05.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:05.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:05.315 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:05.315 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:05.316 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:05.316 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:05.316 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:05.316 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:05.316 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:05.316 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:05.316 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:05.316 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:05.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:05.343 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:05.344 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:05.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.344 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.344 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.344 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:05.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512845391 for job c0988648dfcd43275159a42b4d64d13e.
12:14:05.399 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:05.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:14:05.422 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:05.423 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:05.423 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:05.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:05.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:05.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:05.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:05.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:05.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:05.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:05.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:05.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:05.424 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:05.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:05.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:05.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:05.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:05.828 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:05.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:05.828 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:05.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:05.828 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:05.845 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:05.845 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:05.845 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:05.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.845 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:05.845 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.845 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:05.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:05.846 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:05.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512845891 for job c0988648dfcd43275159a42b4d64d13e.
12:14:05.900 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:05.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
.12:14:05.928 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512845928
12:14:05.928 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512845928
12:14:05.931 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:14:05.934 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:14:05.934 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:14:05.934 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:14:05.935 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:14:05.935 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:14:05.937 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:14:06.015 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:06.016 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:06.016 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:06.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:06.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:06.016 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:06.016 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:06.016 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:06.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:06.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:06.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:06.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:06.017 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:06.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:06.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:06.261 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:14:06.262 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:14:06.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.265015 17161 mini_oidc.cc:150] Starting JWKS server
12:14:06.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.268854 17161 webserver.cc:533] Webserver started at http://127.0.0.1:41059/ using document root <none> and password file <none>
12:14:06.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.269433 17161 mini_oidc.cc:186] Starting OIDC Discovery server
12:14:06.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.271617 17161 webserver.cc:533] Webserver started at http://127.0.0.1:40983/ using document root <none> and password file <none>
12:14:06.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:06.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:06.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:06.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.304 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.304 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.304 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.304 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.304 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:06.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:14:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:06Z Disabled control of system clock
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.332399 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/logs
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data/info.pb
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.126:33897
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.126
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:06.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json with env {}
12:14:06.355 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:06.355 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:06.355 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:06.355 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:06.355 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:06.355 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:06.355 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:06.356 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:06.356 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:06.356 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:06.356 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:06.356 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:06.356 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:06.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512846392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:06.400 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:06.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:14:06.486 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:06.486 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:06.487 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:06.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.487 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.487 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.487 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.487 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:06.543 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:06.543 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:06.543 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:06.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.544 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.626775 17173 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.627346 17173 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.627810 17173 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:06.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:06.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.659632 17173 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.659909 17173 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.660105 17173 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.660310 17173 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.660498 17173 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.660643 17173 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41059/jwks.json
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.697026 17173 master_runner.cc:387] Master server non-default flags:
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.126:33897
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data/info.pb
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.126
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/logs
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:06.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.698253 17173 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:06.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:06.699759 17173 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:06.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.710868 17179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:06.751 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:06.884 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:06.884 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:06.884 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:06.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.885 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.885 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:06.885 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.885 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.885 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:06.885 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.885 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.885 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:06.885 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:06.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512846892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:06.907 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:06.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
12:14:07.006 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:07.007 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:07.007 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:07.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.008 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.008 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.008 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.009 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:07.043 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:07.044 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:07.044 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:07.044 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.044 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.045 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.045 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.045 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.045 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.046 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.046 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.046 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.046 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:07.097 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:07.097 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:07.097 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:07.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.098 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.099 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:07.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:07.215 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:07.215 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:07.215 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:07.216 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.216 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.216 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.217 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.217 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.217 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.217 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.217 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.217 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.217 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:07.230 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:07.231 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:07.231 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:07.231 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.231 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.232 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.232 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.232 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.233 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.233 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:07.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:07.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512847392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:07.406 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:07.407 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:14:07.523 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:07.523 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:07.523 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:07.524 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.524 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.525 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.525 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.525 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.525 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.525 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.525 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.526 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.526 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:07.547 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:07.548 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:07.548 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:07.548 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.548 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:07.548 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:07.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:07.549 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:07.604 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:07.605 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:07.605 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:07.605 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:07.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:07.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:07.606 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:07.606 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:07.606 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:07.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:07.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:07.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:07.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:07.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:07.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:07.865 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:07.866 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:07.866 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:07.866 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.866 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.866 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:07.867 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.867 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.867 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:07.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:07.867 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:07.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512847892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:07.909 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:14:07.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:14:07.916 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:07.917 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:07.917 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:07.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.918 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.918 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:07.918 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:07.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.919 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:07.919 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:08.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:08.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.113211 17178 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 17173
12:14:08.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:06.711419 17180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:08.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.206861 17173 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.496s	user 0.578s	sys 0.916s
12:14:08.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.207197 17173 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.496s	user 0.578s	sys 0.916s
12:14:08.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.209443 17182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:08.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.212320 17181 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1499 milliseconds
12:14:08.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.212344 17173 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:08.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.213553 17173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:08.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.215864 17173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:08.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.217193 17173 hybrid_clock.cc:648] HybridClock initialized: now 1783512848217138 us; error 53 us; skew 500 ppm
12:14:08.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.217941 17173 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:08.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.223666 17173 webserver.cc:533] Webserver started at http://127.16.194.126:42537/ using document root <none> and password file <none>
12:14:08.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.224516 17173 fs_manager.cc:362] Metadata directory not provided
12:14:08.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.224735 17173 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:08.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.225128 17173 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:08.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.229445 17173 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data/instance:
12:14:08.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2766681ead7343328dab9930593d968d"
12:14:08.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:08 on dist-test-slave-vcgh"
12:14:08.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.230545 17173 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal/instance:
12:14:08.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2766681ead7343328dab9930593d968d"
12:14:08.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:08 on dist-test-slave-vcgh"
12:14:08.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.237531 17173 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
12:14:08.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.243064 17189 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.244123 17173 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
12:14:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.244436 17173 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal
12:14:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2766681ead7343328dab9930593d968d"
12:14:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:08 on dist-test-slave-vcgh"
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.244786 17173 fs_report.cc:389] FS layout report
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data/data
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:08.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:08.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.296555 17173 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:08.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.298213 17173 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:08.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.298758 17173 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:08.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.368335 17173 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.126:33897
12:14:08.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.368412 17240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.126:33897 every 8 connection(s)
12:14:08.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.370981 17173 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/data/info.pb
12:14:08.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.376866 17241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.381170 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17173
12:14:08.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.381600 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-0/wal/instance
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.385048 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/logs
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data/info.pb
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.125:40961
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.125
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:08.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json with env {}
12:14:08.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.387286 17241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } has no permanent_uuid. Determining permanent_uuid...
12:14:08.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512848392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:08.403 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:14:08.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:14:08.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.417426 17241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } has no permanent_uuid. Determining permanent_uuid...
12:14:08.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.419863 17192 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.424022 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.473521 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 1
12:14:08.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.478050 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.546428 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 2
12:14:08.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.550575 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.640 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:08.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.641997 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 3
12:14:08.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.646198 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.687331 17243 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:08.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.687875 17243 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:08.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.688333 17243 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:08.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.721889 17243 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:08.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.722169 17243 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:08.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.722375 17243 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:08.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.722611 17243 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:08.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.722852 17243 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:08.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.723039 17243 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41059/jwks.json
12:14:08.727 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:08.727 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:08.727 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:08.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:08.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:08.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:08.727 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:08.727 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:08.728 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:08.728 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:08.728 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:08.728 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:08.728 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:08.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.760674 17243 master_runner.cc:387] Master server non-default flags:
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.125:40961
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data/info.pb
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.125
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/logs
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:08.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.761909 17243 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:08.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:08.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.763491 17243 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:08.763 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:08.764 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:08.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:08.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:08.764 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:08.764 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:08.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:08.764 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:08.764 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:08.764 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:08.764 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:08.764 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:08.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.773993 17252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:08.775 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:08.775 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:08.775 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:08.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:08.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:08.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:08.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:08.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:08.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:08.776 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:08.776 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:08.776 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:08.776 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:08.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:08.789649 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 4
12:14:08.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.796331 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:08.864 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:08.864 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:08.865 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:08.865 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:08.865 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:08.865 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:08.866 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:08.866 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:08.866 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:08.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:08.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:08.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:08.867 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:08.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512848892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:08.910 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:14:08.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:14:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:09.095809 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 5
12:14:09.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:09.102741 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:09.140 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:09.147 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:09.147 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:09.148 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:09.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.150 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.150 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:09.197 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:09.197 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:09.197 [DEBUG - pool-100-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:09.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.198 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.199 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.199 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.199 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.199 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.199 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.199 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:09.200 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26569), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [55ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [56ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [741ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [744ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [881ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [884ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1805ms] refreshing cache from master, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1806ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1808ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5341ms] refreshing cache from master, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5342ms] too many traces: truncated at 100 traces, deferred=Deferred@1211861045(state=PENDING, result=null, callback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511), errback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511)))
12:14:09.201 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:09.201 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26569), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [55ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [56ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [741ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [744ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [881ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [884ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1805ms] refreshing cache from master, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1806ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1808ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5341ms] refreshing cache from master, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5342ms] too many traces: truncated at 100 traces, deferred=Deferred@1211861045(state=PENDING, result=null, callback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511), errback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:09.202 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:14:09.204 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:14:09.207 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=26569), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [55ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [56ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [101ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [741ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [743ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [744ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [881ms] refreshing cache from master, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [883ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [884ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1805ms] refreshing cache from master, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1805ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1806ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1806ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1807ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1808ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5341ms] refreshing cache from master, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5342ms] too many traces: truncated at 100 traces, deferred=Deferred@1211861045(state=PENDING, result=null, callback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511), errback=(continuation of Deferred@1791738971 after retry RPC after error@1262730043) -> (continuation of Deferred@423799754 after retry RPC after error@229434103) -> (continuation of Deferred@972101125 after retry RPC after error@1866332259) -> (continuation of Deferred@1672282805 after retry RPC after error@159182701) -> (continuation of Deferred@940347769 after retry RPC after error@955418875) -> (continuation of Deferred@859938298 after retry RPC after error@1571298168) -> (continuation of Deferred@24370925 after retry RPC after error@761932648) -> (continuation of Deferred@318492018 after retry RPC after error@253061006) -> (continuation of Deferred@277759031 after retry RPC after error@1824721957) -> (continuation of Deferred@547347602 after retry RPC after error@76736024) -> (continuation of Deferred@1725936961 after retry RPC after error@310980507) -> (continuation of Deferred@1277958676 after retry RPC after error@1595770799) -> (continuation of Deferred@1148404912 after retry RPC after error@534597202) -> (continuation of Deferred@864881415 after retry RPC after error@2015782) -> (continuation of Deferred@1586909265 after retry RPC after error@734804495) -> (continuation of Deferred@1891817794 after retry RPC after error@104544910) -> (continuation of Deferred@1782838976 after retry RPC after error@538289605) -> (continuation of Deferred@1190879308 after retry RPC after error@432790871) -> (continuation of Deferred@1816911192 after retry RPC after error@1643996825) -> (continuation of Deferred@2082046954 after retry RPC after error@998234203) -> (continuation of Deferred@166490993 after retry RPC after error@53413243) -> (continuation of Deferred@857325607 after retry RPC after error@1994484511)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:09.208 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:09.217 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
12:14:09.220 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:14:09.220 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:14:09.220 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:14:09.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:09.255 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:09.255 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:09.256 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:09.256 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:09.256 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:09.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:09.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:09.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:09.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:09.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:09.256 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:09.256 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:09.257 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:09.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512849392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:09.409 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:14:09.411 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:14:09.595 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.595 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.596 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.597 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.597 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.597 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.597 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.598 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.598 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.598 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.598 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.598 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27004), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [90ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [783ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [787ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [787ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1685ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1332161721(state=PENDING, result=null, callback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495), errback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495)))
12:14:09.599 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.600 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.600 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.600 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27004), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [90ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [783ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [787ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [787ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1685ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1332161721(state=PENDING, result=null, callback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495), errback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27004), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [90ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [783ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [787ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [787ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1685ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1332161721(state=PENDING, result=null, callback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495), errback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.61:36393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:09.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.601 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.601 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.602 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.602 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.611 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27004), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [90ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [783ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [787ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [787ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1685ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1332161721(state=PENDING, result=null, callback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495), errback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27004), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [50ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [90ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [783ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [787ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [787ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1682ms] refreshing cache from master, [1682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1684ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1685ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1685ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2120ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3280ms] refreshing cache from master, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3282ms] too many traces: truncated at 100 traces, deferred=Deferred@1332161721(state=PENDING, result=null, callback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495), errback=(continuation of Deferred@1183919340 after retry RPC after error@1028300310) -> (continuation of Deferred@960880940 after retry RPC after error@1328615513) -> (continuation of Deferred@570143 after retry RPC after error@1775970086) -> (continuation of Deferred@2130831280 after retry RPC after error@955618257) -> (continuation of Deferred@2099273627 after retry RPC after error@1299363086) -> (continuation of Deferred@1035921271 after retry RPC after error@700547082) -> (continuation of Deferred@1457704494 after retry RPC after error@249617209) -> (continuation of Deferred@1143935181 after retry RPC after error@1632311698) -> (continuation of Deferred@563623979 after retry RPC after error@690558514) -> (continuation of Deferred@356307618 after retry RPC after error@746774046) -> (continuation of Deferred@1278993093 after retry RPC after error@759358966) -> (continuation of Deferred@1578666814 after retry RPC after error@1683016909) -> (continuation of Deferred@2003711816 after retry RPC after error@1295585542) -> (continuation of Deferred@1466053348 after retry RPC after error@892779105) -> (continuation of Deferred@862195704 after retry RPC after error@919640499) -> (continuation of Deferred@1893955743 after retry RPC after error@1879454032) -> (continuation of Deferred@1661926247 after retry RPC after error@1369570228) -> (continuation of Deferred@980244127 after retry RPC after error@2065726515) -> (continuation of Deferred@1868654067 after retry RPC after error@826499056) -> (continuation of Deferred@1632255721 after retry RPC after error@435361559) -> (continuation of Deferred@2103027495 after retry RPC after error@1448008611) -> (continuation of Deferred@1724062453 after retry RPC after error@1728705173) -> (continuation of Deferred@1465455052 after retry RPC after error@2011847495)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.61:36393
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:09.614 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.615 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.615 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.616 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.616 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.616 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.616 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.616 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.616 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.617 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.617 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.617 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.617 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.620 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:14:09.620 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
12:14:09.620 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:14:09.621 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:14:09.621 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:14:09.621 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:14:09.621 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
12:14:09.621 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
12:14:09.622 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
12:14:09.622 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:14:09.632 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:09.632 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:14:09.632 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:14:09.634 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.635 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.635 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.636 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.637 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.637 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.637 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.637 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.644 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:14:09.644 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
12:14:09.644 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:14:09.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:09.650192 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 6
12:14:09.651 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:09.651 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
12:14:09.651 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:14:09.654 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.655 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.655 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.656 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.657 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.657 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.664 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:14:09.664 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:14:09.664 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:14:09.669 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:09.669 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:14:09.669 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:14:09.674 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.675 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.675 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.676 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.676 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.676 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.677 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.677 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.677 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.677 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:09.678419 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.125:40961: Network error: Client connection negotiation failed: client connection to 127.16.194.125:40961: connect: Connection refused (error 111)
12:14:09.682 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
12:14:09.682 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:14:09.683 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:14:09.683 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:14:09.684 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
12:14:09.685 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:09.695 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:14:09.695 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:09.696 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:14:09.714 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.715 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.715 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.716 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.716 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.717 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.717 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.717 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.717 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:09.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.775 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.776 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.776 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.776 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.777 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.777 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.777 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.778 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.796 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.797 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.797 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.797 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.798 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.823 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:09.823 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:09.824 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:09.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.825 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.825 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.826 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:09.844 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:09.845 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:09.845 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:09.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.846 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.846 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.846 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:09.846 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:09.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.846 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:09.846 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:09.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:09.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:09.851 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:09.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.851 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.851 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.851 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:09.852 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:09.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:09.852 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:09.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512849892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:09.897 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:09.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:09.904 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:09.904 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:09.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:09.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.906 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.906 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:09.906 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:09.909 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:14:09.910 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:14:10.070 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:10.071 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:10.071 [DEBUG - pool-98-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:10.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.072 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.072 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.072 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.072 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.072 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.072 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.072 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:10.073 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27470), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [16ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [18ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [18ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [37ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [80ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [80ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [402ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [402ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [402ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [402ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [821ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [822ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1300ms] refreshing cache from master, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1301ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1302ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1341ms] refreshing cache from master, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1343ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1344ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1345ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1602ms] too many traces: truncated at 100 traces, deferred=Deferred@904521074(state=PENDING, result=null, callback=(continuation of Deferred@1265461144 after retry RPC after error@1713076023) -> (continuation of Deferred@1018706895 after retry RPC after error@1182829407) -> (continuation of Deferred@1718707632 after retry RPC after error@1533936774) -> (continuation of Deferred@653605479 after retry RPC after error@1693292437) -> (continuation of Deferred@157037149 after retry RPC after error@582831556) -> (continuation of Deferred@756317686 after retry RPC after error@634197758) -> (continuation of Deferred@1307252416 after retry RPC after error@91267540) -> (continuation of Deferred@184915777 after retry RPC after error@1186077241) -> (continuation of Deferred@1408915769 after retry RPC after error@1392782483) -> (continuation of Deferred@1947997741 after retry RPC after error@581544261) -> (continuation of Deferred@588980152 after retry RPC after error@1367986172) -> (continuation of Deferred@1169163934 after retry RPC after error@716991724) -> (continuation of Deferred@1369522396 after retry RPC after error@1321767739) -> (continuation of Deferred@193591434 after retry RPC after error@1109077531) -> (continuation of Deferred@434577700 after retry RPC after error@322713704) -> (continuation of Deferred@1463144237 after retry RPC after error@1287997478) -> (continuation of Deferred@1812704923 after retry RPC after error@512107530) -> (continuation of Deferred@1739836496 after retry RPC after error@22101240) -> (continuation of Deferred@807351615 after retry RPC after error@529981762) -> (continuation of Deferred@1723760556 after retry RPC after error@1853892991) -> (continuation of Deferred@671047517 after retry RPC after error@264971793) -> (continuation of Deferred@446528347 after retry RPC after error@1966695078), errback=(continuation of Deferred@1265461144 after retry RPC after error@1713076023) -> (continuation of Deferred@1018706895 after retry RPC after error@1182829407) -> (continuation of Deferred@1718707632 after retry RPC after error@1533936774) -> (continuation of Deferred@653605479 after retry RPC after error@1693292437) -> (continuation of Deferred@157037149 after retry RPC after error@582831556) -> (continuation of Deferred@756317686 after retry RPC after error@634197758) -> (continuation of Deferred@1307252416 after retry RPC after error@91267540) -> (continuation of Deferred@184915777 after retry RPC after error@1186077241) -> (continuation of Deferred@1408915769 after retry RPC after error@1392782483) -> (continuation of Deferred@1947997741 after retry RPC after error@581544261) -> (continuation of Deferred@588980152 after retry RPC after error@1367986172) -> (continuation of Deferred@1169163934 after retry RPC after error@716991724) -> (continuation of Deferred@1369522396 after retry RPC after error@1321767739) -> (continuation of Deferred@193591434 after retry RPC after error@1109077531) -> (continuation of Deferred@434577700 after retry RPC after error@322713704) -> (continuation of Deferred@1463144237 after retry RPC after error@1287997478) -> (continuation of Deferred@1812704923 after retry RPC after error@512107530) -> (continuation of Deferred@1739836496 after retry RPC after error@22101240) -> (continuation of Deferred@807351615 after retry RPC after error@529981762) -> (continuation of Deferred@1723760556 after retry RPC after error@1853892991) -> (continuation of Deferred@671047517 after retry RPC after error@264971793) -> (continuation of Deferred@446528347 after retry RPC after error@1966695078)))
12:14:10.094 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:10.095 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:10.095 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:10.096 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.096 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.096 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.096 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.096 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.097 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.097 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.097 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.097 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:10.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.177477 17251 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 17243
12:14:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.281991 17243 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.508s	user 0.551s	sys 0.925s
12:14:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:08.774766 17253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.282577 17243 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.508s	user 0.551s	sys 0.925s
12:14:10.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.284291 17255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.287617 17254 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1508 milliseconds
12:14:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.287691 17243 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:10.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.288985 17243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:10.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.291326 17243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:10.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.292646 17243 hybrid_clock.cc:648] HybridClock initialized: now 1783512850292581 us; error 71 us; skew 500 ppm
12:14:10.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.293421 17243 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:10.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.299196 17243 webserver.cc:533] Webserver started at http://127.16.194.125:38203/ using document root <none> and password file <none>
12:14:10.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.300031 17243 fs_manager.cc:362] Metadata directory not provided
12:14:10.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.300210 17243 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:10.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.300592 17243 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:10.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.304913 17243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data/instance:
12:14:10.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0388277478f45ee8e74b8463b12b806"
12:14:10.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:10 on dist-test-slave-vcgh"
12:14:10.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.305979 17243 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal/instance:
12:14:10.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0388277478f45ee8e74b8463b12b806"
12:14:10.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:10 on dist-test-slave-vcgh"
12:14:10.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.312966 17243 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
12:14:10.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.318380 17273 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:10.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.319423 17243 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.319749 17243 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0388277478f45ee8e74b8463b12b806"
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:10 on dist-test-slave-vcgh"
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.320072 17243 fs_report.cc:389] FS layout report
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data/data
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:10.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:10.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.372071 17243 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:10.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.373886 17243 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:10.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.374286 17243 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:10.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512850392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:10.401 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:10.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:14:10.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.449343 17243 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.125:40961
12:14:10.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.449429 17324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.125:40961 every 8 connection(s)
12:14:10.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.452065 17243 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/data/info.pb
12:14:10.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.454041 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17243
12:14:10.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.454528 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-1/wal/instance
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.456949 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/logs
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data/info.pb
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.124:36205
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.124
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:10.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json with env {}
12:14:10.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.458549 17325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:10.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.468955 17325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } has no permanent_uuid. Determining permanent_uuid...
12:14:10.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.502043 17325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } has no permanent_uuid. Determining permanent_uuid...
12:14:10.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.517395 17325 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } has no permanent_uuid. Determining permanent_uuid...
12:14:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.519886 17276 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.524022 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.573628 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 1
12:14:10.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.577900 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.646245 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 2
12:14:10.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.650367 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.738833 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } attempt: 7
12:14:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.741703 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 3
12:14:10.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.746165 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.750 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:10.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.750993 17241 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } has no permanent_uuid. Determining permanent_uuid...
12:14:10.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.756250 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.765192 17327 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:10.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.765756 17327 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:10.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.766222 17327 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:10.794 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:10.794 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:10.795 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:10.795 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.795 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.795 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.795 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.795 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.795 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:10.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.795 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:10.795 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:10.795 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:10.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.799047 17327 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:10.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.799316 17327 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:10.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.799516 17327 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:10.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.799711 17327 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.799906 17327 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:10.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.800047 17327 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41059/jwks.json
12:14:10.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.814688 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 1
12:14:10.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.818946 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.837540 17327 master_runner.cc:387] Master server non-default flags:
12:14:10.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.124:36205
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41059/jwks.json
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data/info.pb
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.124
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/logs
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.838778 17327 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:10.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.840287 17327 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:10.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.850449 17339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:10.868 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:10.869 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.869 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.869 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:10.869 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:10.870 [DEBUG - pool-96-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:10.870 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.870 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.870 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:10.870 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.870 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.870 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:10.870 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:10.871 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28283), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [66ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [66ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [126ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [126ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [165ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [384ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [384ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [402ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [402ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [403ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [403ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] refreshing cache from master, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [704ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [704ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [821ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [822ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1840ms] refreshing cache from master, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1841ms] too many traces: truncated at 100 traces, deferred=Deferred@2032144629(state=PENDING, result=null, callback=(continuation of Deferred@852425184 after retry RPC after error@1982313156) -> (continuation of Deferred@1705091089 after retry RPC after error@486515688) -> (continuation of Deferred@1505450094 after retry RPC after error@306278415) -> (continuation of Deferred@2047409022 after retry RPC after error@453633844) -> (continuation of Deferred@418558995 after retry RPC after error@19557898) -> (continuation of Deferred@1011131994 after retry RPC after error@1746982561) -> (continuation of Deferred@1702864282 after retry RPC after error@938986753) -> (continuation of Deferred@781769683 after retry RPC after error@1080264063) -> (continuation of Deferred@1487453084 after retry RPC after error@1363077709) -> (continuation of Deferred@957408762 after retry RPC after error@1703204826) -> (continuation of Deferred@2028856493 after retry RPC after error@1579619711) -> (continuation of Deferred@1621496948 after retry RPC after error@593442237) -> (continuation of Deferred@872445431 after retry RPC after error@1391067877) -> (continuation of Deferred@37726584 after retry RPC after error@1477936735) -> (continuation of Deferred@1863319399 after retry RPC after error@1836066121) -> (continuation of Deferred@318449142 after retry RPC after error@1991933064) -> (continuation of Deferred@1717453311 after retry RPC after error@174619152) -> (continuation of Deferred@1098332734 after retry RPC after error@1686913188) -> (continuation of Deferred@1883874419 after retry RPC after error@968423568) -> (continuation of Deferred@1097237331 after retry RPC after error@1206481595) -> (continuation of Deferred@2050898953 after retry RPC after error@71055270) -> (continuation of Deferred@1907708009 after retry RPC after error@2101712974), errback=(continuation of Deferred@852425184 after retry RPC after error@1982313156) -> (continuation of Deferred@1705091089 after retry RPC after error@486515688) -> (continuation of Deferred@1505450094 after retry RPC after error@306278415) -> (continuation of Deferred@2047409022 after retry RPC after error@453633844) -> (continuation of Deferred@418558995 after retry RPC after error@19557898) -> (continuation of Deferred@1011131994 after retry RPC after error@1746982561) -> (continuation of Deferred@1702864282 after retry RPC after error@938986753) -> (continuation of Deferred@781769683 after retry RPC after error@1080264063) -> (continuation of Deferred@1487453084 after retry RPC after error@1363077709) -> (continuation of Deferred@957408762 after retry RPC after error@1703204826) -> (continuation of Deferred@2028856493 after retry RPC after error@1579619711) -> (continuation of Deferred@1621496948 after retry RPC after error@593442237) -> (continuation of Deferred@872445431 after retry RPC after error@1391067877) -> (continuation of Deferred@37726584 after retry RPC after error@1477936735) -> (continuation of Deferred@1863319399 after retry RPC after error@1836066121) -> (continuation of Deferred@318449142 after retry RPC after error@1991933064) -> (continuation of Deferred@1717453311 after retry RPC after error@174619152) -> (continuation of Deferred@1098332734 after retry RPC after error@1686913188) -> (continuation of Deferred@1883874419 after retry RPC after error@968423568) -> (continuation of Deferred@1097237331 after retry RPC after error@1206481595) -> (continuation of Deferred@2050898953 after retry RPC after error@71055270) -> (continuation of Deferred@1907708009 after retry RPC after error@2101712974)))
12:14:10.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.889711 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 4
12:14:10.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512850892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:10.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.896260 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.900334 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 2
12:14:10.907 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:10.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:14:10.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.910434 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:10.995918 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 3
12:14:11.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:11.003167 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:11.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:11.143663 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 4
12:14:11.147 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:11.148 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:11.148 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:11.148 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.148 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.148 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.148 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.149 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.149 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.150 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:11.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:11.153363 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:11.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:11.195701 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 5
12:14:11.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:11.202772 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:11.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:11.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512851392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:11.409 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:14:11.410 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:14:11.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:11.436831 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 5
12:14:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:11.443806 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:11.504 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:11.504 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:11.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.505 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.505 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.505 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.505 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.505 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.505 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:11.505 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.505 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.506 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.506 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:11.626 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:11.626 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:11.626 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:11.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.627 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:11.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:11.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.628 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:11.628 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:11.654 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.655 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.655 [DEBUG - pool-92-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.655 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.656 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.656 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.657 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.657 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.657 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.657 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.657 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.659 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:14:11.659 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:14:11.660 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
12:14:11.660 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:14:11.661 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
12:14:11.662 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
12:14:11.662 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:14:11.662 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
12:14:11.663 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
12:14:11.663 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:14:11.663 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
12:14:11.663 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
12:14:11.663 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:14:11.664 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:11.664 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:11.664 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:11.665 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:14:11.666 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:14:11.667 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
12:14:11.667 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:11.669 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:14:11.669 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
12:14:11.669 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:14:11.670 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:14:11.670 [INFO - Thread-28] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:14:11.670 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:14:11.670 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
12:14:11.670 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
12:14:11.670 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:14:11.670 [DEBUG - Thread-28] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:14:11.670 [DEBUG - Thread-28] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:11.672 [INFO - Thread-28] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:14:11.672 [INFO - Thread-28] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:14:11.673 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:14:11.675 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:14:11.676 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:14:11.681 [DEBUG - Thread-28] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:11.681 [INFO - Thread-28] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:11.681 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
12:14:11.681 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
12:14:11.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5e3fa312
12:14:11.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:11.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:11.682 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:14:11.684 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:14:11.689 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:11.689 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:11.689 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:11.689 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:11.690 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:14:11.691 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6359b73
12:14:11.695 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:11.704 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@ab8eea2
12:14:11.704 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:11.704 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:11.705 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:14:11.705 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
12:14:11.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
12:14:11.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@405de571
12:14:11.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:11.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:11.707 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:14:11.709 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:14:11.710 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:14:11.719 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@43762b99
12:14:11.719 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b4a4fe0
12:14:11.725 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:11.726 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:11.732 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
12:14:11.732 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
12:14:11.732 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@af6a1ed
12:14:11.732 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:11.733 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:11.735 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:14:11.736 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:14:11.739 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.741 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@317e69a9
12:14:11.744 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:11.745 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.746 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.747 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.747 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:11.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.749 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.749 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.749 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.750 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:11.750236 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 6
12:14:11.751 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.751 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.752 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.752 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.754 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.756 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.757 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.758 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.758 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.758 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.759 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.759 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.760 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.765 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.766 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.766 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.767 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.768 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.769 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.769 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.770 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.770 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.770 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.771 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.771 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.772 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.772 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.772 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.772 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.773 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.773 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.774 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.774 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.775 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.776 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.776 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.776 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.777 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.777 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.777 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.777 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.778 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.778 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.779 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.780 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.780 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.780 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.780 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.780 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.780 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:11.784669 17325 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:11.786 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.787 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.788 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.790 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.791 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.791 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.791 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.791 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.791 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.791 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.791 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.791 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.792 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.796 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.798 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.798 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.798 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.799 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.799 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.802 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.802 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.802 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.802 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.803 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.804 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.804 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.804 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.804 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.805 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.805 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.805 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.805 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.806 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.806 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.806 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.806 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.806 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.807 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.807 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.807 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.807 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.808 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.808 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.808 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.808 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.808 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.809 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.809 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.809 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.809 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.810 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.810 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.810 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.811 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.815 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:11.815 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:11.815 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:11.815 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:11.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:11.815 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:11.816 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:11.816 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:11.816 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:11.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:11.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:11.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:11.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:11.817 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.817 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.818 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.819 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.819 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.819 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.819 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.819 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.819 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.819 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.822 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.823 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.825 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.825 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.825 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.825 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.826 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.828 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.828 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.828 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.828 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.828 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.829 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.829 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.829 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.829 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.829 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.852 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.852 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.852 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.855 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.855 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.855 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.856 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.856 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.858 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.858 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.859 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.859 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.859 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.859 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.859 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.859 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.860 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.860 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.860 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.851 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.860 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.858 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:11.858 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.861 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.861 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.857 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.861 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.861 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.861 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.861 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.862 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.862 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.862 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.862 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.862 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.862 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.867 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.867 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.868 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.868 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.868 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.868 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.868 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.868 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.868 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.879 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.880 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.880 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.880 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.881 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.881 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.881 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.881 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.881 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.881 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.881 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.886 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.886 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.886 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.886 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.886 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.886 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.886 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.886 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.887 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.887 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.887 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.887 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.887 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.887 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.887 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.888 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.888 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.888 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.888 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.888 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.889 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.889 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.889 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.889 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.889 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.889 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.891 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.891 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.891 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.891 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.892 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512851892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:11.902 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.902 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.902 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.903 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.903 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.903 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.904 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.907 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:11.908 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.908 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.908 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.909 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.909 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.909 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.909 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.910 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:14:11.911 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.912 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.912 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.912 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.912 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.913 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.913 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.913 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.913 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.919 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.919 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.919 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.919 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.919 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.920 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.920 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.920 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.920 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.920 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.920 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.920 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.925 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.926 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.926 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.926 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.926 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.926 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.927 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.945 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:11.946 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:11.946 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:11.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.946 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.946 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:11.947 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.947 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.947 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:11.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:11.948 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:11.948 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.948 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.948 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.948 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.949 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.949 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.949 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.949 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.949 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.949 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.950 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.950 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.967 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.967 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.967 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.968 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.968 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.968 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.969 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.969 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.969 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.969 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.969 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.970 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.970 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.970 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.970 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.971 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.979 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.979 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.979 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.979 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.980 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.980 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.980 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.980 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.991 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:11.992 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:11.992 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:11.992 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.993 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.993 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:11.993 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.993 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:11.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.993 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.993 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:11.993 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:11.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:11.996294 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 6
12:14:12.007 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.007 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.007 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.008 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.008 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.008 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.008 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.008 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.008 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.026065 17241 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.194.124:36205: Network error: Client connection negotiation failed: client connection to 127.16.194.124:36205: connect: Connection refused (error 111)
12:14:12.043 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.043 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.043 [DEBUG - pool-94-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.044 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.044 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.044 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.045 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.045 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.045 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.045 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.045 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.045 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:12.046 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:12.046 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:12.046 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.046 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.046 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.046 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29466), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [52ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [54ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [75ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [77ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [77ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [97ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [98ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [99ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [99ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [323ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [324ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [324ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [324ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [602ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [603ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [603ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [604ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [942ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [943ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [943ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [943ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1161ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1163ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1221ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1222ms] too many traces: truncated at 100 traces, deferred=Deferred@816900697(state=PENDING, result=null, callback=(continuation of Deferred@952731496 after retry RPC after error@156513029) -> (continuation of Deferred@1206618151 after retry RPC after error@1891516577) -> (continuation of Deferred@70806297 after retry RPC after error@744270976) -> (continuation of Deferred@938324892 after retry RPC after error@894715528) -> (continuation of Deferred@1920172952 after retry RPC after error@998382074) -> (continuation of Deferred@1638476869 after retry RPC after error@1985894142) -> (continuation of Deferred@417297646 after retry RPC after error@859431878) -> (continuation of Deferred@458894048 after retry RPC after error@523728595) -> (continuation of Deferred@2083260895 after retry RPC after error@16249423) -> (continuation of Deferred@1253098907 after retry RPC after error@1855304688) -> (continuation of Deferred@1928015116 after retry RPC after error@1303497876) -> (continuation of Deferred@23151780 after retry RPC after error@1118338379) -> (continuation of Deferred@1761651551 after retry RPC after error@706088839) -> (continuation of Deferred@559491589 after retry RPC after error@546982208) -> (continuation of Deferred@1277973599 after retry RPC after error@1457258602) -> (continuation of Deferred@1044189622 after retry RPC after error@1285525368) -> (continuation of Deferred@1648337944 after retry RPC after error@1423320933) -> (continuation of Deferred@45104360 after retry RPC after error@853837705) -> (continuation of Deferred@761592489 after retry RPC after error@1215040879) -> (continuation of Deferred@1261973494 after retry RPC after error@1576415703) -> (continuation of Deferred@1473067378 after retry RPC after error@2145538449) -> (continuation of Deferred@1966052868 after retry RPC after error@431712767) -> (continuation of Deferred@654562579 after retry RPC after error@1249928891) -> (continuation of Deferred@1125537369 after retry RPC after error@27274069) -> (continuation of Deferred@942857535 after retry RPC after error@1900986684), errback=(continuation of Deferred@952731496 after retry RPC after error@156513029) -> (continuation of Deferred@1206618151 after retry RPC after error@1891516577) -> (continuation of Deferred@70806297 after retry RPC after error@744270976) -> (continuation of Deferred@938324892 after retry RPC after error@894715528) -> (continuation of Deferred@1920172952 after retry RPC after error@998382074) -> (continuation of Deferred@1638476869 after retry RPC after error@1985894142) -> (continuation of Deferred@417297646 after retry RPC after error@859431878) -> (continuation of Deferred@458894048 after retry RPC after error@523728595) -> (continuation of Deferred@2083260895 after retry RPC after error@16249423) -> (continuation of Deferred@1253098907 after retry RPC after error@1855304688) -> (continuation of Deferred@1928015116 after retry RPC after error@1303497876) -> (continuation of Deferred@23151780 after retry RPC after error@1118338379) -> (continuation of Deferred@1761651551 after retry RPC after error@706088839) -> (continuation of Deferred@559491589 after retry RPC after error@546982208) -> (continuation of Deferred@1277973599 after retry RPC after error@1457258602) -> (continuation of Deferred@1044189622 after retry RPC after error@1285525368) -> (continuation of Deferred@1648337944 after retry RPC after error@1423320933) -> (continuation of Deferred@45104360 after retry RPC after error@853837705) -> (continuation of Deferred@761592489 after retry RPC after error@1215040879) -> (continuation of Deferred@1261973494 after retry RPC after error@1576415703) -> (continuation of Deferred@1473067378 after retry RPC after error@2145538449) -> (continuation of Deferred@1966052868 after retry RPC after error@431712767) -> (continuation of Deferred@654562579 after retry RPC after error@1249928891) -> (continuation of Deferred@1125537369 after retry RPC after error@27274069) -> (continuation of Deferred@942857535 after retry RPC after error@1900986684)))
12:14:12.046 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.046 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.046 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.046 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:12.051 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.052 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.052 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.052 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.052 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.052 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.053 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.053 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.053 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.053 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.053 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.053 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.053 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.099 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.099 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.100 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.100 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.100 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.101 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.101 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.101 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.101 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.101 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.101 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.101 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.126 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.127 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.127 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.128 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.128 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.128 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.128 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.128 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.129 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.129 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.227 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.228 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.228 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.229 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.229 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.229 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.230 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.230 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.230 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:12.254 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.255 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.255 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.256 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.256 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.256 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.256 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.256 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.257 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.259 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.260 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.260 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.261 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.254319 17338 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 17327
12:14:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.267905 17327 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.417s	user 0.524s	sys 0.846s
12:14:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:10.850931 17340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:12.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.268277 17327 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.418s	user 0.524s	sys 0.846s
12:14:12.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.269402 17341 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1417 milliseconds
12:14:12.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.270092 17327 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:12.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.270170 17342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:12.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.273150 17327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:12.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.275573 17327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.276986 17327 hybrid_clock.cc:648] HybridClock initialized: now 1783512852276945 us; error 34 us; skew 500 ppm
12:14:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.277772 17327 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:12.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.284253 17327 webserver.cc:533] Webserver started at http://127.16.194.124:40645/ using document root <none> and password file <none>
12:14:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.285142 17327 fs_manager.cc:362] Metadata directory not provided
12:14:12.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.285337 17327 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:12.285 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:12.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.285831 17327 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:12.286 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:12.286 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:12.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.286 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.287 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:12.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.290452 17327 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data/instance:
12:14:12.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f404846cba944dcf8554423792b761fa"
12:14:12.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:12 on dist-test-slave-vcgh"
12:14:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.291832 17327 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal/instance:
12:14:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f404846cba944dcf8554423792b761fa"
12:14:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:12 on dist-test-slave-vcgh"
12:14:12.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.299089 17327 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.003s
12:14:12.299 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.300 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.300 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.300 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.300 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.300 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.300 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.300 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.304741 17407 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.305871 17327 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.306141 17327 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f404846cba944dcf8554423792b761fa"
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:12 on dist-test-slave-vcgh"
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.306448 17327 fs_report.cc:389] FS layout report
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data/data
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:12.324 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:12.324 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:12.325 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:12.325 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:12.325 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:12.325 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:12.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:12.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:12.325 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:12.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:12.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:12.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:12.325 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:12.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:12.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.357719 17327 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:12.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.359251 17327 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:12.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.359720 17327 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:12.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512852392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:12.402 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:12.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:14:12.419 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.420 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.420 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.420 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.421 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.426 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.427 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.427 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.427 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.427 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.427 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.427 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.427 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.427 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.428 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.428 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.428 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.428 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.434882 17327 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.124:36205
12:14:12.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.434990 17458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.124:36205 every 8 connection(s)
12:14:12.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.437587 17327 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/data/info.pb
12:14:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.443207 17459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.445667 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17327
12:14:12.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.446115 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/master-2/wal/instance
12:14:12.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.461333 17459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } has no permanent_uuid. Determining permanent_uuid...
12:14:12.479 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.479 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.479 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.479 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.480 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.480 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.480 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.479 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.480 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.480 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.480 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.485561 17459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } has no permanent_uuid. Determining permanent_uuid...
12:14:12.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.494716 17459 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } has no permanent_uuid. Determining permanent_uuid...
12:14:12.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.509961 17459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: Bootstrap starting.
12:14:12.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.516548 17459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: Neither blocks nor log segments found. Creating new log.
12:14:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.518283 17459 log.cc:826] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: Log is configured to *not* fsync() on all Append() calls
12:14:12.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.522677 17459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: No bootstrap required, opened a new log
12:14:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.542553 17459 raft_consensus.cc:359] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.543150 17459 raft_consensus.cc:385] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.543346 17459 raft_consensus.cc:740] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f404846cba944dcf8554423792b761fa, State: Initialized, Role: FOLLOWER
12:14:12.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.544062 17459 consensus_queue.cc:260] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.546208 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:12.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.546777 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: This master's current role is: FOLLOWER
12:14:12.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.547569 17459 sys_catalog.cc:565] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: configured and running, proceeding with master startup.
12:14:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.571367 17479 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.571879 17479 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:12.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.567967 17327 master_runner.cc:187] Error getting master registration for 127.16.194.126:33897: OK, instance_id { permanent_uuid: "2766681ead7343328dab9930593d968d" instance_seqno: 1783512848348883 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:12.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.596973 17327 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:12.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.614713 17413 tablet.cc:2406] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:12.646 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:12.646 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:12.646 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:12.647 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.647 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.647 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.647 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.647 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.647 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.647 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:12.667 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.668 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.668 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.668 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.668 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.668 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.668 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.668 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.727 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.727 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.727 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.728 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.728 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.728 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.728 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.728 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.731 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.731 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.731 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.731 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.732 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.732 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.732 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.732 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.732 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.732 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.732 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.732 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.732 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:12.785 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:12.785 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:12.786 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:12.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:12.787 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.787 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:12.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:12.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:12.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:12.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:12.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.788 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.788 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.788 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:12.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:12.788 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:12.788 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:12.788 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:12.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:12.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.845178 17325 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 7
12:14:12.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.861799 17325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: Bootstrap starting.
12:14:12.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.867470 17325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: Neither blocks nor log segments found. Creating new log.
12:14:12.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.869879 17325 log.cc:826] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: Log is configured to *not* fsync() on all Append() calls
12:14:12.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.874444 17325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: No bootstrap required, opened a new log
12:14:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.891961 17325 raft_consensus.cc:359] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.892556 17325 raft_consensus.cc:385] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.893025 17325 raft_consensus.cc:740] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0388277478f45ee8e74b8463b12b806, State: Initialized, Role: FOLLOWER
12:14:12.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512852892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:12.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.893883 17325 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.898468 17483 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:12.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.899421 17483 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: This master's current role is: FOLLOWER
12:14:12.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.900310 17325 sys_catalog.cc:565] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: configured and running, proceeding with master startup.
12:14:12.902 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:12.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:14:12.924 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:12.924 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:12.924 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:12.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:12.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:12.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:12.925 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:12.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.929208 17468 raft_consensus.cc:493] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:12.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.929725 17468 raft_consensus.cc:515] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.932245 17494 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:12.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:12.932706 17494 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:12.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.933177 17468 leader_election.cc:290] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2766681ead7343328dab9930593d968d (127.16.194.126:33897), a0388277478f45ee8e74b8463b12b806 (127.16.194.125:40961)
12:14:12.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.933702 17300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f404846cba944dcf8554423792b761fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0388277478f45ee8e74b8463b12b806" is_pre_election: true
12:14:12.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.934552 17300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f404846cba944dcf8554423792b761fa in term 0.
12:14:12.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.936647 17410 leader_election.cc:304] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0388277478f45ee8e74b8463b12b806, f404846cba944dcf8554423792b761fa; no voters: 
12:14:12.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.938571 17468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:12.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.939246 17468 raft_consensus.cc:493] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:12.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.939994 17468 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 0 FOLLOWER]: Advancing to term 1
12:14:12.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.951681 17468 raft_consensus.cc:515] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:12.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.926581 17243 master_runner.cc:187] Error getting master registration for 127.16.194.126:33897: OK, instance_id { permanent_uuid: "2766681ead7343328dab9930593d968d" instance_seqno: 1783512848348883 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:12.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.965101 17243 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:12.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.966069 17468 leader_election.cc:290] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [CANDIDATE]: Term 1 election: Requested vote from peers 2766681ead7343328dab9930593d968d (127.16.194.126:33897), a0388277478f45ee8e74b8463b12b806 (127.16.194.125:40961)
12:14:12.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.967074 17300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f404846cba944dcf8554423792b761fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0388277478f45ee8e74b8463b12b806"
12:14:12.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.967615 17300 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 0 FOLLOWER]: Advancing to term 1
12:14:12.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.974152 17300 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f404846cba944dcf8554423792b761fa in term 1.
12:14:12.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.975163 17410 leader_election.cc:304] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0388277478f45ee8e74b8463b12b806, f404846cba944dcf8554423792b761fa; no voters: 
12:14:12.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.976040 17468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 1 FOLLOWER]: Leader election won for term 1
12:14:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.983718 17468 raft_consensus.cc:697] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [term 1 LEADER]: Becoming Leader. State: Replica: f404846cba944dcf8554423792b761fa, State: Running, Role: LEADER
12:14:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:12.984848 17468 consensus_queue.cc:237] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:13.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.006124 17496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader f404846cba944dcf8554423792b761fa. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.006912 17496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: This master's current role is: LEADER
12:14:13.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.009681 17498 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:14:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.016852 17498 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:14:13.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.038048 17300 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [term 1 FOLLOWER]: Refusing update from remote peer f404846cba944dcf8554423792b761fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:13.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.039800 17468 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:13.046 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:13.047 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:13.047 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:13.047 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.047 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.047 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.047 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.047 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.047 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.048 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.059525 17241 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } attempt: 7
12:14:13.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.063103 17483 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f404846cba944dcf8554423792b761fa. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.067066 17499 mvcc.cc:204] Tried to move back new op lower bound from 7305268646007672832 to 7305268645836107776. Current Snapshot: MvccSnapshot[applied={T|T < 7305268646007672832}]
12:14:13.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.066926 17483 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: This master's current role is: FOLLOWER
12:14:13.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.077478 17496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.078155 17496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: This master's current role is: LEADER
12:14:13.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.077610 17500 mvcc.cc:204] Tried to move back new op lower bound from 7305268646007672832 to 7305268645836107776. Current Snapshot: MvccSnapshot[applied={T|T < 7305268646007672832}]
12:14:13.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.083673 17483 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.085901 17483 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806 [sys.catalog]: This master's current role is: FOLLOWER
12:14:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.087039 17498 catalog_manager.cc:1383] Generated new cluster ID: 47fcbd400bdc4dfba42a756c486876c7
12:14:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.087340 17498 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:14:13.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.107250 17241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: Bootstrap starting.
12:14:13.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.125310 17241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: Neither blocks nor log segments found. Creating new log.
12:14:13.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.127521 17241 log.cc:826] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: Log is configured to *not* fsync() on all Append() calls
12:14:13.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.138396 17498 catalog_manager.cc:1406] Generated new certificate authority record
12:14:13.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.142164 17498 catalog_manager.cc:1540] Loading token signing keys...
12:14:13.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.153149 17241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: No bootstrap required, opened a new log
12:14:13.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.179128 17498 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa: Generated new TSK 0
12:14:13.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.180295 17498 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.198058 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/logs
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data/info.pb
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.65:0
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.65
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.65
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:13.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:13.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.202625 17241 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:13.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.203545 17241 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:13.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.203848 17241 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2766681ead7343328dab9930593d968d, State: Initialized, Role: FOLLOWER
12:14:13.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.205085 17241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } }
12:14:13.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.220837 17507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.221856 17507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: This master's current role is: FOLLOWER
12:14:13.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.225086 17241 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: configured and running, proceeding with master startup.
12:14:13.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.225232 17216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f404846cba944dcf8554423792b761fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2766681ead7343328dab9930593d968d" is_pre_election: true
12:14:13.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.227023 17215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f404846cba944dcf8554423792b761fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2766681ead7343328dab9930593d968d"
12:14:13.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.226135 17216 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f404846cba944dcf8554423792b761fa in term 0.
12:14:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.231626 17214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 0 FOLLOWER]: Advancing to term 1
12:14:13.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.239537 17214 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [term 1 FOLLOWER]: Refusing update from remote peer f404846cba944dcf8554423792b761fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:13.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:13.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.247606 17496 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.301589 17507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f404846cba944dcf8554423792b761fa. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.302276 17507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: This master's current role is: FOLLOWER
12:14:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.301833 17515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.302573 17515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d [sys.catalog]: This master's current role is: FOLLOWER
12:14:13.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:13.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.344367 17523 catalog_manager.cc:1295] Loaded cluster ID: 47fcbd400bdc4dfba42a756c486876c7
12:14:13.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.344640 17523 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: loading cluster ID for follower catalog manager: success
12:14:13.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.352126 17523 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: acquiring CA information for follower catalog manager: success
12:14:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.358163 17523 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2766681ead7343328dab9930593d968d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:13.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512853392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:13.405 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:13.406 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:13.406 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:13.406 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:13.406 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:13.406 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:13.406 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:13.407 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:13.407 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:13.409 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:13.409 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:13.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:13.409 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:13.413 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:14:13.414 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:14:13.552 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:13.552 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:13.552 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:13.552 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.553 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.553 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.553 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.553 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.553 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.553 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:13.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.654420 17496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f404846cba944dcf8554423792b761fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2766681ead7343328dab9930593d968d" member_type: VOTER last_known_addr { host: "127.16.194.126" port: 33897 } } peers { permanent_uuid: "a0388277478f45ee8e74b8463b12b806" member_type: VOTER last_known_addr { host: "127.16.194.125" port: 40961 } } peers { permanent_uuid: "f404846cba944dcf8554423792b761fa" member_type: VOTER last_known_addr { host: "127.16.194.124" port: 36205 } } }
12:14:13.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.655167 17496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa [sys.catalog]: This master's current role is: LEADER
12:14:13.687 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:13.687 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:13.688 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:13.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:13.689 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.689 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.689 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:13.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:13.689 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:13.747 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:13.747 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:13.747 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:13.747 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.748 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.748 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:13.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:13.748 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.748 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.748 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:13.748 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:13.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:13.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:13.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:13.881274 17506 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:13.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:13.881902 17506 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:13.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:13.882822 17506 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:13.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512853891 for job c0988648dfcd43275159a42b4d64d13e.
12:14:13.902 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:14:13.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:14:13.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.938633 17494 catalog_manager.cc:1295] Loaded cluster ID: 47fcbd400bdc4dfba42a756c486876c7
12:14:13.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.939121 17494 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: loading cluster ID for follower catalog manager: success
12:14:13.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:13.945555 17506 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:13.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:13.947063 17506 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.194.65
12:14:13.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.950551 17494 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: acquiring CA information for follower catalog manager: success
12:14:13.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:13.965096 17494 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a0388277478f45ee8e74b8463b12b806: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:14.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:14.023325 17506 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:14.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:14.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:14.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.65:0
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data/info.pb
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.65
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.65
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/logs
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:14.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:14.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:14.026242 17506 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:14.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:14.028918 17506 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:14.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:14.060670 17530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:14.095 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:14.095 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:14.095 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:14.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.096 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.096 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.096 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:14.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:14.307 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:14.307 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:14.308 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:14.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.308 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.308 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.309 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.309 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:14.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:14.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512854391 for job c0988648dfcd43275159a42b4d64d13e.
12:14:14.406 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:14.407 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:14:14.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:14.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:14.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:14.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.420 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.420 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.420 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.421 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.421 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.421 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.421 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.421 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:14.446 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:14.446 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:14.446 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:14.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:14.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:14.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:14.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:14.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:14.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:14.447 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:14.447 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:14.447 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:14.447 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:14.485 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:14.485 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:14.486 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:14.486 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.486 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.486 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.486 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.486 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.486 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.489 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.489 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.489 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.489 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:14.595 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:14.595 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:14.596 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:14.596 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.596 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.596 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.596 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:14.596 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.596 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.596 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:14.596 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:14.597 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:14.607 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:14.607 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:14.607 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:14.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.608 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.608 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.608 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.608 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.609 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:14.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:14.786 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:14.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:14.787 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:14.788 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.788 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.788 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:14.788 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.788 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.788 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:14.789 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.789 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.789 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:14.789 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:14.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:14.843 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:14.844 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:14.844 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:14.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:14.845 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.845 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.845 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:14.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:14.845 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:14.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512854892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:14.906 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:14:14.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:14:15.151 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:15.151 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:15.152 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:15.152 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.152 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.152 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.153 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.153 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.153 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.153 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.153 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.153 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.153 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:15.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:15.279 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:15.279 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:15.279 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:15.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.280 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.280 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:15.280 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:15.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:15.281 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:15.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:15.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512855392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:15.402 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:15.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:14:15.495 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:15.495 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:15.496 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:15.496 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.496 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.496 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.496 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.496 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.496 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.496 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.496 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.497 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:15.523 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:15.524 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:15.524 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.524 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:15.524 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.524 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.525 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.525 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.525 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.525 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.525 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.525 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.525 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:15.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:15.767 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:15.767 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:15.767 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:15.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:15.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.769 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:15.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.769 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:15.769 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:15.786 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:15.786 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:15.786 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:15.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:15.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:15.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:15.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:15.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:15.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:15.789 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:15.789 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:15.789 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:15.789 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:15.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:15.844 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:15.844 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:15.845 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:15.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:15.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:15.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:15.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:15.846 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:15.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:15.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:15.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:15.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:15.846 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:15.875 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:15.875 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:15.875 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:15.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:15.877 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.877 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:15.877 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.877 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.877 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:15.877 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:15.881755 17506 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.816s	user 0.364s	sys 0.544s
12:14:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:15.453059 17529 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 17506
12:14:15.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:15.884308 17506 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.818s	user 0.365s	sys 0.544s
12:14:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:14.068370 17531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:15.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512855892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:15.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:15.897161 17540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:15.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.899531 17506 server_base.cc:1061] running on GCE node
12:14:15.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.900978 17506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:15.902 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:15.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:14:15.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.904052 17506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:15.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.905568 17506 hybrid_clock.cc:648] HybridClock initialized: now 1783512855905530 us; error 30 us; skew 500 ppm
12:14:15.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.906723 17506 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:15.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.914197 17506 webserver.cc:533] Webserver started at http://127.16.194.65:38277/ using document root <none> and password file <none>
12:14:15.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.915412 17506 fs_manager.cc:362] Metadata directory not provided
12:14:15.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.915669 17506 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:15.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.916255 17506 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:15.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.922253 17506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data/instance:
12:14:15.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:15.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:15 on dist-test-slave-vcgh"
12:14:15.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.923719 17506 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal/instance:
12:14:15.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:15.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:15 on dist-test-slave-vcgh"
12:14:15.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.931690 17506 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:14:15.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.938777 17545 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:15.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.939986 17506 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
12:14:15.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.940379 17506 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal
12:14:15.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:15.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:15 on dist-test-slave-vcgh"
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:15.940830 17506 fs_report.cc:389] FS layout report
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data/data
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:15.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:16.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.006177 17506 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:16.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.008134 17506 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:16.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.008710 17506 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:16.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.012158 17506 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:16.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.018028 17506 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:16.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.018328 17506 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:16.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.018631 17506 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:16.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.018857 17506 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:16.067 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:16.068 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:16.068 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:16.068 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.068 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.068 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.068 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.068 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.068 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.068 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.068 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.068 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.068 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:16.164 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:16.165 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:16.165 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:16.165 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:16.165 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:16.165 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:16.165 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:16.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:16.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:16.166 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:16.166 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:16.166 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:16.166 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:16.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.173856 17506 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.65:46145
12:14:16.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.173925 17657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.65:46145 every 8 connection(s)
12:14:16.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.177446 17506 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/data/info.pb
12:14:16.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.188653 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17506
12:14:16.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.189179 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-0/wal/instance
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.200168 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/logs
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data/info.pb
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:16.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.66:0
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.66
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.66
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:16.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.228101 17658 heartbeater.cc:344] Connected to a master server at 127.16.194.125:40961
12:14:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.228618 17658 heartbeater.cc:461] Registering TS with master...
12:14:16.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.229957 17658 heartbeater.cc:507] Master 127.16.194.125:40961 requested a full tablet report, sending...
12:14:16.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.231262 17659 heartbeater.cc:344] Connected to a master server at 127.16.194.124:36205
12:14:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.231617 17659 heartbeater.cc:461] Registering TS with master...
12:14:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.232441 17659 heartbeater.cc:507] Master 127.16.194.124:36205 requested a full tablet report, sending...
12:14:16.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.233340 17290 ts_manager.cc:194] Registered new tserver with Master: b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145)
12:14:16.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.235507 17660 heartbeater.cc:344] Connected to a master server at 127.16.194.126:33897
12:14:16.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.235860 17660 heartbeater.cc:461] Registering TS with master...
12:14:16.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.236428 17424 ts_manager.cc:194] Registered new tserver with Master: b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145)
12:14:16.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.236760 17660 heartbeater.cc:507] Master 127.16.194.126:33897 requested a full tablet report, sending...
12:14:16.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.241081 17206 ts_manager.cc:194] Registered new tserver with Master: b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145)
12:14:16.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.241112 17424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.194.65:45871
12:14:16.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:16.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:16.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512856392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:16.402 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:16.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:14:16.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:16.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:16.420 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:16.420 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.420 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.420 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:16.421 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.421 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.421 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:16.421 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.421 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.421 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:16.421 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.552582 17668 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.553187 17668 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.553772 17668 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:16.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.588464 17668 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:16.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.589407 17668 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.194.66
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.631968 17668 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.66:0
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data/info.pb
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.66
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.66
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/logs
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:16.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:16.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.633496 17668 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:16.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:16.635154 17668 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:16.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.648140 17676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:16.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:16.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:16.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512856892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:16.906 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:16.907 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:14:17.106 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:17.106 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:17.106 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:17.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.108 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:17.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.245098 17659 heartbeater.cc:499] Master 127.16.194.124:36205 was elected leader, sending a full tablet report...
12:14:17.250 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:17.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:17.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512857392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:17.411 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:14:17.412 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:14:17.606 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:17.607 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:17.607 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:17.608 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:17.608 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:17.608 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:17.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:17.609 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:17.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:17.609 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:17.609 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:17.609 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:17.609 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:17.646 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:17.647 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:17.647 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:17.647 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.647 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.647 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.647 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.647 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.648 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.648 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.648 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:17.704 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:17.704 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:17.705 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:17.705 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:17.705 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:17.705 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:17.705 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:17.705 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:17.705 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:17.705 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:17.705 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:17.706 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:17.706 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:17.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:16.649114 17677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:17.823 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:17.824 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:17.824 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:17.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:17.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:17.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:17.824627 17668 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.178s	user 0.498s	sys 0.674s
12:14:17.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:17.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:17.825001 17668 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.178s	user 0.502s	sys 0.674s
12:14:17.825 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:17.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.829471 17668 server_base.cc:1061] running on GCE node
12:14:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:17.831130 17681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:17.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.832522 17668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:17.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.835204 17668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:17.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.836771 17668 hybrid_clock.cc:648] HybridClock initialized: now 1783512857836730 us; error 28 us; skew 500 ppm
12:14:17.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.837873 17668 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.846136 17668 webserver.cc:533] Webserver started at http://127.16.194.66:42823/ using document root <none> and password file <none>
12:14:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.847311 17668 fs_manager.cc:362] Metadata directory not provided
12:14:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.847600 17668 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.848290 17668 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:17.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.854367 17668 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data/instance:
12:14:17.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:17.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:17 on dist-test-slave-vcgh"
12:14:17.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.855792 17668 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal/instance:
12:14:17.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:17.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:17 on dist-test-slave-vcgh"
12:14:17.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.865134 17668 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.004s
12:14:17.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.871151 17687 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:17.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.872403 17668 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.872762 17668 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:17 on dist-test-slave-vcgh"
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.873075 17668 fs_report.cc:389] FS layout report
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data/data
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:17.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512857892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:17.906 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:17.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:14:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.938360 17668 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.939921 17668 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:17.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.940425 17668 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:17.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.942996 17668 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:17.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.947196 17668 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:17.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.947402 17668 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:17.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.947680 17668 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:17.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:17.947842 17668 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:18.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.079417 17668 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.66:35941
12:14:18.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.079546 17799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.66:35941 every 8 connection(s)
12:14:18.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.082037 17668 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/data/info.pb
12:14:18.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.092136 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17668
12:14:18.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.092804 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-1/wal/instance
12:14:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.108443 17161 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal
12:14:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/logs
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data/info.pb
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.67:0
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.67
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.67
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.121253 17802 heartbeater.cc:344] Connected to a master server at 127.16.194.126:33897
12:14:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.121486 17801 heartbeater.cc:344] Connected to a master server at 127.16.194.124:36205
12:14:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.121766 17802 heartbeater.cc:461] Registering TS with master...
12:14:18.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.121876 17801 heartbeater.cc:461] Registering TS with master...
12:14:18.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.123082 17802 heartbeater.cc:507] Master 127.16.194.126:33897 requested a full tablet report, sending...
12:14:18.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.124457 17800 heartbeater.cc:344] Connected to a master server at 127.16.194.125:40961
12:14:18.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.124819 17800 heartbeater.cc:461] Registering TS with master...
12:14:18.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.125691 17800 heartbeater.cc:507] Master 127.16.194.125:40961 requested a full tablet report, sending...
12:14:18.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.126042 17206 ts_manager.cc:194] Registered new tserver with Master: 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:18.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.130118 17801 heartbeater.cc:507] Master 127.16.194.124:36205 requested a full tablet report, sending...
12:14:18.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.130280 17290 ts_manager.cc:194] Registered new tserver with Master: 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:18.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.132508 17424 ts_manager.cc:194] Registered new tserver with Master: 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:18.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.133872 17424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.194.66:57363
12:14:18.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:18.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:18.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:18.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:18.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:18.303 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:18.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:18.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:18.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:18.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:18.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:18.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:18.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:18.304 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:18.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:18.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512858391 for job c0988648dfcd43275159a42b4d64d13e.
12:14:18.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:18.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:14:18.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.422567 17810 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:18.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.423058 17810 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:18.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.423568 17810 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:18.471 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:18.471 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:18.471 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:18.472 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:18.472 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:18.472 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:18.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:18.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:18.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:18.473 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:18.473 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:18.473 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:18.473 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:18.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.475019 17810 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:18.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.476311 17810 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.194.67
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.513834 17810 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.194.84:39303
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.194.67:0
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data/info.pb
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.194.67
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.194.126:33897,127.16.194.125:40961,127.16.194.124:36205
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.194.67
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/logs
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:18.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:18.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.515116 17810 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:18.516702 17810 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:18.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.528559 17816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:18.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:18.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:18.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:18.626 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:18.626 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:18.626 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:18.626 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:18.626 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:18.626 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:18.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:18.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:18.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:18.627 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:18.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:18.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:18.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512858892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:18.906 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:18.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:14:18.975 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:18.976 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:18.976 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:18.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:18.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:18.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:18.977 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:18.977 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:18.977 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:18.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:18.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:18.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:18.977 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:19.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.137102 17801 heartbeater.cc:499] Master 127.16.194.124:36205 was elected leader, sending a full tablet report...
12:14:19.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:19.264 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:19.264 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:19.264 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:19.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.266 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.266 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.266 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:19.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:19.363 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:19.364 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:19.364 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:19.364 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.364 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.364 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.364 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.364 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.364 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.364 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.365 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.365 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.365 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:19.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512859392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:19.403 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:19.404 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:19.404 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:19.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:19.405 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.405 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.405 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:19.405 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:19.405 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:19.414 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
12:14:19.416 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:14:19.504 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:19.505 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:19.505 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:19.505 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:19.505 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:19.505 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:19.505 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:19.505 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:19.506 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:19.506 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:19.506 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:19.506 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:19.506 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:19.545 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:19.546 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:19.546 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:19.546 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:19.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:19.547 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:19.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:19.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:19.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:19.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:19.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:19.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:19.548 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:19.619 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:19.619 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:19.619 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:19.620 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.620 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.620 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.620 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.620 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:19.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.533146 17819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:19.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:18.530088 17817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:19.729003 17818 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1195 milliseconds
12:14:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.729110 17810 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:19.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.730280 17810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:19.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.732610 17810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:19.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.734000 17810 hybrid_clock.cc:648] HybridClock initialized: now 1783512859733966 us; error 38 us; skew 500 ppm
12:14:19.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.734791 17810 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:19.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.740908 17810 webserver.cc:533] Webserver started at http://127.16.194.67:42945/ using document root <none> and password file <none>
12:14:19.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.741765 17810 fs_manager.cc:362] Metadata directory not provided
12:14:19.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.741983 17810 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:19.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.742460 17810 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.746711 17810 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data/instance:
12:14:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:19 on dist-test-slave-vcgh"
12:14:19.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.747833 17810 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal/instance:
12:14:19.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:19.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:19 on dist-test-slave-vcgh"
12:14:19.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:19.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.755806 17810 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
12:14:19.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.761204 17827 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:19.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.762192 17810 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
12:14:19.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.762466 17810 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal
12:14:19.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:19.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:19 on dist-test-slave-vcgh"
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.762739 17810 fs_report.cc:389] FS layout report
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data/data
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:19.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:19.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.811290 17810 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:19.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.812769 17810 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:19.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.813200 17810 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:19.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.815733 17810 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:19.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.819753 17810 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:19.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.819991 17810 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:19.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.820276 17810 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:19.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.820477 17810 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:19.827 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:19.827 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:19.827 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:19.828 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.828 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.828 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:19.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:19.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512859892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:19.901 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:19.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:14:19.967 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:19.967 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:19.968 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:19.968 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.968 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.968 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:19.968 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:19.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.969 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:19.969 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.970759 17810 rpc_server.cc:307] RPC server started. Bound to: 127.16.194.67:34965
12:14:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.970866 17940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.194.67:34965 every 8 connection(s)
12:14:19.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.973487 17810 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/data/info.pb
12:14:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.978034 17161 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17810
12:14:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:19.978499 17161 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5994388368334661598/ts-2/wal/instance
12:14:20.006 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:20.007 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.007 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:20.007 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.007 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.007 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:20.007 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.007 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.008 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.008 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.008 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.008 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.008 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:20.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.012316 17942 heartbeater.cc:344] Connected to a master server at 127.16.194.124:36205
12:14:20.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.012853 17942 heartbeater.cc:461] Registering TS with master...
12:14:20.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.014183 17942 heartbeater.cc:507] Master 127.16.194.124:36205 requested a full tablet report, sending...
12:14:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.015976 17943 heartbeater.cc:344] Connected to a master server at 127.16.194.126:33897
12:14:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.016307 17943 heartbeater.cc:461] Registering TS with master...
12:14:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.017189 17943 heartbeater.cc:507] Master 127.16.194.126:33897 requested a full tablet report, sending...
12:14:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.017210 17941 heartbeater.cc:344] Connected to a master server at 127.16.194.125:40961
12:14:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.017611 17941 heartbeater.cc:461] Registering TS with master...
12:14:20.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.018453 17941 heartbeater.cc:507] Master 127.16.194.125:40961 requested a full tablet report, sending...
12:14:20.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.019830 17206 ts_manager.cc:194] Registered new tserver with Master: e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:20.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.019856 17423 ts_manager.cc:194] Registered new tserver with Master: e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:20.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.021515 17423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.194.67:44249
12:14:20.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.023871 17290 ts_manager.cc:194] Registered new tserver with Master: e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:20.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.041078 17161 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:14:20.045 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:20.046 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:20.046 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:20.046 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:20.046 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:20.046 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:20.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:20.046 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:20.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:20.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:20.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:20.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:20.046 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:20.052 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:14:20.052 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:14:20.054 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.16.194.126"
      port: 33897
    }
    bound_http_address {
      host: "127.16.194.126"
      port: 42537
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.16.194.125"
      port: 40961
    }
    bound_http_address {
      host: "127.16.194.125"
      port: 38203
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.16.194.124"
      port: 36205
    }
    bound_http_address {
      host: "127.16.194.124"
      port: 40645
    }
  }
}

12:14:20.054 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:14:20.055 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.16.194.65"
      port: 46145
    }
    bound_http_address {
      host: "127.16.194.65"
      port: 38277
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.16.194.66"
      port: 35941
    }
    bound_http_address {
      host: "127.16.194.66"
      port: 42823
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.16.194.67"
      port: 34965
    }
    bound_http_address {
      host: "127.16.194.67"
      port: 42945
    }
  }
}

12:14:20.055 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:14:20.057 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:20.057 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:14:20.057 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:14:20.057 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:14:20.057 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:14:20.060 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:14:20.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:20.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:20.387 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:14:20.387 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:14:20.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.390295 17951 mini_oidc.cc:150] Starting JWKS server
12:14:20.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512860392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:20.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.393682 17951 webserver.cc:533] Webserver started at http://127.0.0.1:33147/ using document root <none> and password file <none>
12:14:20.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.394192 17951 mini_oidc.cc:186] Starting OIDC Discovery server
12:14:20.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.396413 17951 webserver.cc:533] Webserver started at http://127.0.0.1:34413/ using document root <none> and password file <none>
12:14:20.401 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:20.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:14:20.439 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:20.439 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:20.440 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:20.440 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.440 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.440 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.440 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.440 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.440 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.440 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.440 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.440 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.440 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:20.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:20Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:14:20.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:20Z Disabled control of system clock
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.457283 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/logs
12:14:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data/info.pb
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.254:37603
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.254
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json with env {}
12:14:20.685 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:20.685 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:20.685 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:20.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:20.686 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:20.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:20.686 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:20.686 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:20.686 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:20.686 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:20.686 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:20.686 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:20.686 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:20.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:20.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.763324 17963 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:20.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.763855 17963 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:20.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.764336 17963 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.797168 17963 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.797449 17963 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.797654 17963 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.797863 17963 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:20.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.798053 17963 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:20.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.798199 17963 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33147/jwks.json
12:14:20.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:20.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.834544 17963 master_runner.cc:387] Master server non-default flags:
12:14:20.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:20.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:20.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.254:37603
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data/info.pb
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.254
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/logs
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:20.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:20.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.835882 17963 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:20.837535 17963 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:20.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.847600 17970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:20.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512860892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:20.904 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:14:20.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:14:20.987 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:20.987 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:20.987 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:20.987 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:20.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:20.989 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.989 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.989 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:20.989 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:21.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:21.025265 17942 heartbeater.cc:499] Master 127.16.194.124:36205 was elected leader, sending a full tablet report...
12:14:21.204 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:21.205 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:21.205 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:21.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.206 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.206 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.206 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.206 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:21.226 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:21.227 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:21.227 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:21.227 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.227 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.227 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.227 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.227 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.228 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.228 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.228 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.228 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:21.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:21.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:21.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:21.303 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:21.304 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.304 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.305 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.305 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.305 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.305 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:21.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:21.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512861392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:21.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:21.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:14:21.726 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:21.726 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:21.726 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:21.726 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.727 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:21.726 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.727 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:21.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:21.727 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:21.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:21.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:21.851 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:21.852 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:21.852 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:21.853 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:21.853 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:21.853 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:21.853 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:21.853 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:21.853 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:21.854 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:21.854 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:21.854 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:21.854 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:21.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512861892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:21.901 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:21.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:14:22.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.202708 17796 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba480 after lost signal to thread 17670
12:14:22.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.203989 17796 debug-util.cc:398] Leaking SignalData structure 0x7b08000bae60 after lost signal to thread 17799
12:14:22.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:22.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:22.347 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:22.347 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:22.347 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:22.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:22.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:22.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:22.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:22.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:22.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:22.349 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:22.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:22.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:22.349 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:22.394 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512862392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:22.406 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:22.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.251746 17969 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 17963
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.498147 17969 kernel_stack_watchdog.cc:198] Thread 17963 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:14:22.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:14:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.498911 17963 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.650s	user 0.598s	sys 0.951s
12:14:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.499264 17963 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.651s	user 0.598s	sys 0.951s
12:14:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.499332 17972 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1648 milliseconds
12:14:22.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:20.848713 17971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:22.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.500735 17973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:22.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.500674 17963 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:22.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.505666 17963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:22.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.518669 17963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:22.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.522274 17963 hybrid_clock.cc:648] HybridClock initialized: now 1783512862522222 us; error 55 us; skew 500 ppm
12:14:22.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.523418 17963 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:22.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.531306 17963 webserver.cc:533] Webserver started at http://127.17.135.254:44207/ using document root <none> and password file <none>
12:14:22.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.532538 17963 fs_manager.cc:362] Metadata directory not provided
12:14:22.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.532836 17963 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:22.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.533392 17963 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:22.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.539403 17963 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data/instance:
12:14:22.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "461bcb2a5da74be2a0508b9acd127405"
12:14:22.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:22 on dist-test-slave-vcgh"
12:14:22.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.540830 17963 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal/instance:
12:14:22.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "461bcb2a5da74be2a0508b9acd127405"
12:14:22.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:22 on dist-test-slave-vcgh"
12:14:22.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.549734 17963 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
12:14:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.555584 17980 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.556845 17963 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.557207 17963 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "461bcb2a5da74be2a0508b9acd127405"
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:22 on dist-test-slave-vcgh"
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.557526 17963 fs_report.cc:389] FS layout report
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:22.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data/data
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:22.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:22.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.615262 17963 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.616832 17963 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.617228 17963 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:22.675 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:22.675 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:22.676 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:22.676 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:22.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:22.676 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:22.676 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:22.676 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:22.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:22.676 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:22.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:22.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:22.676 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:22.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.698359 17963 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.254:37603
12:14:22.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.698504 18031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.254:37603 every 8 connection(s)
12:14:22.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.701247 17963 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/data/info.pb
12:14:22.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.703199 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 17963
12:14:22.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.704814 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-0/wal/instance
12:14:22.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.708921 18032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.710253 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/logs
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data/info.pb
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:22.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.253:43339
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.253
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json with env {}
12:14:22.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.722983 18032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } has no permanent_uuid. Determining permanent_uuid...
12:14:22.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:22.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.769135 18032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } has no permanent_uuid. Determining permanent_uuid...
12:14:22.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.772063 17983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:22.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.776749 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:22.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.826254 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 1
12:14:22.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.831568 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:22.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:22.846 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:22.846 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:22.846 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:22.846 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:22.846 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:22.846 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:22.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:22.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:22.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:22.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:22.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:22.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:22.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:22.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512862891 for job c0988648dfcd43275159a42b4d64d13e.
12:14:22.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.900007 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 2
12:14:22.901 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:22.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:14:22.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:22.905956 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:22.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:22.997391 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 3
12:14:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.002466 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:23.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.040295 18034 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:23.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.040859 18034 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:23.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.041318 18034 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:23.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.076332 18034 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:23.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.076712 18034 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.077028 18034 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.077390 18034 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.077868 18034 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.078102 18034 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33147/jwks.json
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:23.116346 18034 master_runner.cc:387] Master server non-default flags:
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal
12:14:23.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.253:43339
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data/info.pb
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.253
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/logs
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:23.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:23.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:23.117878 18034 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:23.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:23.119431 18034 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:23.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.130677 18043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:23.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:23.145898 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 4
12:14:23.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.153083 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:23.224 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.224 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.225 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.225 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.225 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.226 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:23.226 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:23.226 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:23.226 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.226 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.226 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.227 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.227 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.227 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.227 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.227 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.227 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:23.228 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.228 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.228 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.229 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27553), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [70ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [88ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [88ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [108ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [131ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [187ms] refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [190ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [190ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [325ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [326ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [421ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [425ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [425ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [944ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1063ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2940ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1969424883(state=PENDING, result=null, callback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133), errback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133)))
12:14:23.230 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.230 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.230 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.230 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27553), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [70ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [88ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [88ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [108ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [131ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [187ms] refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [190ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [190ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [325ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [326ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [421ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [425ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [425ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [944ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1063ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2940ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1969424883(state=PENDING, result=null, callback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133), errback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27553), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [70ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [88ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [88ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [108ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [131ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [187ms] refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [190ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [190ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [325ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [326ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [421ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [425ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [425ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [944ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1063ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2940ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1969424883(state=PENDING, result=null, callback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133), errback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:23.230 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.230 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.230 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.231 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.231 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.231 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.231 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.231 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.231 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.237 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27553), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [70ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [88ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [88ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [108ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [131ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [187ms] refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [190ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [190ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [325ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [326ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [421ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [425ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [425ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [944ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1063ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2940ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1969424883(state=PENDING, result=null, callback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133), errback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27553), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [30ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [30ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [53ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [57ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [57ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [68ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [70ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [70ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [86ms] refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [87ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [88ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [88ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [108ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [108ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [127ms] refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [131ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [131ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [187ms] refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [188ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [189ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [190ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [190ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [325ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [326ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [326ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [421ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [424ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [425ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [425ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [942ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [943ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [944ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1063ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2940ms] refreshing cache from master, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2941ms] too many traces: truncated at 100 traces, deferred=Deferred@1969424883(state=PENDING, result=null, callback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133), errback=(continuation of Deferred@1843874037 after retry RPC after error@508536723) -> (continuation of Deferred@1669088501 after retry RPC after error@238941688) -> (continuation of Deferred@1498068010 after retry RPC after error@979035055) -> (continuation of Deferred@998261757 after retry RPC after error@1525932864) -> (continuation of Deferred@1452603344 after retry RPC after error@1002316086) -> (continuation of Deferred@35131927 after retry RPC after error@1202985207) -> (continuation of Deferred@913264038 after retry RPC after error@2081586636) -> (continuation of Deferred@1045975283 after retry RPC after error@1506579567) -> (continuation of Deferred@352510093 after retry RPC after error@2047939580) -> (continuation of Deferred@112331653 after retry RPC after error@1004570832) -> (continuation of Deferred@962855337 after retry RPC after error@1259891594) -> (continuation of Deferred@1566617423 after retry RPC after error@1660492347) -> (continuation of Deferred@2064197252 after retry RPC after error@1942312532) -> (continuation of Deferred@721913268 after retry RPC after error@17132077) -> (continuation of Deferred@856314255 after retry RPC after error@1789187660) -> (continuation of Deferred@2107229321 after retry RPC after error@1474792725) -> (continuation of Deferred@905984079 after retry RPC after error@2061143669) -> (continuation of Deferred@1230286891 after retry RPC after error@573575985) -> (continuation of Deferred@356877688 after retry RPC after error@994183299) -> (continuation of Deferred@1467687464 after retry RPC after error@1978669677) -> (continuation of Deferred@1286029294 after retry RPC after error@1728717033) -> (continuation of Deferred@1777218626 after retry RPC after error@473458784) -> (continuation of Deferred@1763011654 after retry RPC after error@1605244133)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:23.239 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:14:23.239 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:14:23.240 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
12:14:23.240 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
12:14:23.241 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:14:23.241 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to CANCELING.
12:14:23.241 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:14:23.241 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
12:14:23.241 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:14:23.242 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
12:14:23.242 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:14:23.242 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
12:14:23.242 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:14:23.244 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.245 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.245 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.246 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.246 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.247 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.247 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.247 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.247 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.253 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:14:23.253 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
12:14:23.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:14:23.261 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:14:23.261 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:14:23.261 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:14:23.263 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:14:23.263 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:14:23.263 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:14:23.263 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:14:23.263 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:14:23.263 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:14:23.264 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.265 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.265 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:14:23.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:14:23.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:14:23.265 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.266 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.266 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.266 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.266 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.266 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.266 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:14:23.266 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:14:23.266 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:14:23.267 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.267 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.267 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.267 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.273 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:14:23.273 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:14:23.273 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:14:23.282 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:14:23.282 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
12:14:23.283 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:14:23.283 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:14:23.283 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CANCELING to CANCELED.
12:14:23.284 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:14:23.284 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.285 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.285 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:23.285 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.285 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:23.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.286 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.286 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.287 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.287 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.285 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:14:23.287 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:23.288 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:14:23.289 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:14:23.305 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.305 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.305 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.307 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.307 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.307 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:23.344 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.345 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.345 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.346 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.346 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.347 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.347 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.347 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.347 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.347 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.347 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.385 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:23.386 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:23.386 [DEBUG - pool-106-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:23.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.386 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.386 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.386 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.387 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.387 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:23.387 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27707), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [13ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [14ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [35ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [37ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [37ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [51ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [52ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [52ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [84ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [123ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [123ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [942ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [943ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [943ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [943ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1700ms] refreshing cache from master, [1700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1702ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3660ms] refreshing cache from master, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3661ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3662ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3662ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3662ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4200ms] refreshing cache from master, [4200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4202ms] too many traces: truncated at 100 traces, deferred=Deferred@1722711121(state=PENDING, result=null, callback=(continuation of Deferred@1711570337 after retry RPC after error@1995415867) -> (continuation of Deferred@30424212 after retry RPC after error@336172043) -> (continuation of Deferred@1369770590 after retry RPC after error@1523097384) -> (continuation of Deferred@1526475897 after retry RPC after error@34427617) -> (continuation of Deferred@2072203012 after retry RPC after error@1697431171) -> (continuation of Deferred@1586022843 after retry RPC after error@922354385) -> (continuation of Deferred@1474330725 after retry RPC after error@1463350460) -> (continuation of Deferred@1340418801 after retry RPC after error@695158102) -> (continuation of Deferred@2061437878 after retry RPC after error@1792183621) -> (continuation of Deferred@201752652 after retry RPC after error@1594892655) -> (continuation of Deferred@1561330560 after retry RPC after error@601232834) -> (continuation of Deferred@459994388 after retry RPC after error@1160750159) -> (continuation of Deferred@419345257 after retry RPC after error@185978289) -> (continuation of Deferred@1192971154 after retry RPC after error@2142147298) -> (continuation of Deferred@304485253 after retry RPC after error@930819125) -> (continuation of Deferred@715241107 after retry RPC after error@554899623) -> (continuation of Deferred@59481403 after retry RPC after error@1837040635) -> (continuation of Deferred@1254958569 after retry RPC after error@1940052535) -> (continuation of Deferred@748675901 after retry RPC after error@971656590) -> (continuation of Deferred@439080247 after retry RPC after error@2143147815) -> (continuation of Deferred@745035238 after retry RPC after error@1191570392) -> (continuation of Deferred@54729826 after retry RPC after error@316078018), errback=(continuation of Deferred@1711570337 after retry RPC after error@1995415867) -> (continuation of Deferred@30424212 after retry RPC after error@336172043) -> (continuation of Deferred@1369770590 after retry RPC after error@1523097384) -> (continuation of Deferred@1526475897 after retry RPC after error@34427617) -> (continuation of Deferred@2072203012 after retry RPC after error@1697431171) -> (continuation of Deferred@1586022843 after retry RPC after error@922354385) -> (continuation of Deferred@1474330725 after retry RPC after error@1463350460) -> (continuation of Deferred@1340418801 after retry RPC after error@695158102) -> (continuation of Deferred@2061437878 after retry RPC after error@1792183621) -> (continuation of Deferred@201752652 after retry RPC after error@1594892655) -> (continuation of Deferred@1561330560 after retry RPC after error@601232834) -> (continuation of Deferred@459994388 after retry RPC after error@1160750159) -> (continuation of Deferred@419345257 after retry RPC after error@185978289) -> (continuation of Deferred@1192971154 after retry RPC after error@2142147298) -> (continuation of Deferred@304485253 after retry RPC after error@930819125) -> (continuation of Deferred@715241107 after retry RPC after error@554899623) -> (continuation of Deferred@59481403 after retry RPC after error@1837040635) -> (continuation of Deferred@1254958569 after retry RPC after error@1940052535) -> (continuation of Deferred@748675901 after retry RPC after error@971656590) -> (continuation of Deferred@439080247 after retry RPC after error@2143147815) -> (continuation of Deferred@745035238 after retry RPC after error@1191570392) -> (continuation of Deferred@54729826 after retry RPC after error@316078018)))
12:14:23.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512863392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:23.400 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:23.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:14:23.426 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.426 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.427 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.428 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.427 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.429 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:23.452518 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 5
12:14:23.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.458654 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:23.484 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.486 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.487 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.487 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.487 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.487 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.488 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.488 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.488 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.488 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.488 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.489 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.489 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.603 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:23.603 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:23.603 [DEBUG - pool-104-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:23.604 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.604 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.604 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.605 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.605 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.605 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.605 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.606 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:23.606 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27943), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [7ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [19ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [20ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [52ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [56ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [57ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [57ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [66ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [84ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [85ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [144ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [144ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [191ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [192ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [193ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [193ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [194ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [194ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [583ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [583ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [583ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [903ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [903ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [903ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [904ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2881ms] refreshing cache from master, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2882ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2882ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2882ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [6261ms] refreshing cache from master, [6261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6262ms] too many traces: truncated at 100 traces, deferred=Deferred@1130697476(state=PENDING, result=null, callback=(continuation of Deferred@1621644214 after retry RPC after error@37630369) -> (continuation of Deferred@1750224748 after retry RPC after error@54828113) -> (continuation of Deferred@567495276 after retry RPC after error@1385419982) -> (continuation of Deferred@683727071 after retry RPC after error@255946626) -> (continuation of Deferred@888849452 after retry RPC after error@2013483993) -> (continuation of Deferred@1445685798 after retry RPC after error@1376924190) -> (continuation of Deferred@808146900 after retry RPC after error@1381259155) -> (continuation of Deferred@1604545957 after retry RPC after error@476194445) -> (continuation of Deferred@1990018850 after retry RPC after error@101019309) -> (continuation of Deferred@1116726669 after retry RPC after error@1339356447) -> (continuation of Deferred@1407979408 after retry RPC after error@2125554502) -> (continuation of Deferred@1127174800 after retry RPC after error@733690855) -> (continuation of Deferred@412623247 after retry RPC after error@1833355913) -> (continuation of Deferred@1413791331 after retry RPC after error@651350799) -> (continuation of Deferred@2132740611 after retry RPC after error@618038763) -> (continuation of Deferred@1427148980 after retry RPC after error@1701477298) -> (continuation of Deferred@1646406158 after retry RPC after error@1917518460) -> (continuation of Deferred@588233137 after retry RPC after error@361685385) -> (continuation of Deferred@1720699756 after retry RPC after error@1283292451) -> (continuation of Deferred@316774188 after retry RPC after error@1879158352) -> (continuation of Deferred@1758318487 after retry RPC after error@1333666760) -> (continuation of Deferred@1371051516 after retry RPC after error@741786293) -> (continuation of Deferred@704713171 after retry RPC after error@341776184), errback=(continuation of Deferred@1621644214 after retry RPC after error@37630369) -> (continuation of Deferred@1750224748 after retry RPC after error@54828113) -> (continuation of Deferred@567495276 after retry RPC after error@1385419982) -> (continuation of Deferred@683727071 after retry RPC after error@255946626) -> (continuation of Deferred@888849452 after retry RPC after error@2013483993) -> (continuation of Deferred@1445685798 after retry RPC after error@1376924190) -> (continuation of Deferred@808146900 after retry RPC after error@1381259155) -> (continuation of Deferred@1604545957 after retry RPC after error@476194445) -> (continuation of Deferred@1990018850 after retry RPC after error@101019309) -> (continuation of Deferred@1116726669 after retry RPC after error@1339356447) -> (continuation of Deferred@1407979408 after retry RPC after error@2125554502) -> (continuation of Deferred@1127174800 after retry RPC after error@733690855) -> (continuation of Deferred@412623247 after retry RPC after error@1833355913) -> (continuation of Deferred@1413791331 after retry RPC after error@651350799) -> (continuation of Deferred@2132740611 after retry RPC after error@618038763) -> (continuation of Deferred@1427148980 after retry RPC after error@1701477298) -> (continuation of Deferred@1646406158 after retry RPC after error@1917518460) -> (continuation of Deferred@588233137 after retry RPC after error@361685385) -> (continuation of Deferred@1720699756 after retry RPC after error@1283292451) -> (continuation of Deferred@316774188 after retry RPC after error@1879158352) -> (continuation of Deferred@1758318487 after retry RPC after error@1333666760) -> (continuation of Deferred@1371051516 after retry RPC after error@741786293) -> (continuation of Deferred@704713171 after retry RPC after error@341776184)))
12:14:23.667 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:23.667 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:23.667 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:23.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:23.668 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:23.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.670 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.670 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:23.670 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:23.684 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:23.685 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:23.685 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:23.685 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.685 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.685 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:23.686 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.686 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.686 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:23.686 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.686 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:23.687 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:23.708 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:23.708 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:23.708 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:23.708 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.708 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.708 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.708 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.709 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.709 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.709 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.709 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:23.711 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:23.712 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:23.712 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:23.712 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.712 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.712 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:23.712 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.712 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.712 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:23.712 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.713 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:23.713 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:23.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:23.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512863892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:23.908 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:14:23.909 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:14:24.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.006116 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 6
12:14:24.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.036208 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.253:43339: Network error: Client connection negotiation failed: client connection to 127.17.135.253:43339: connect: Connection refused (error 111)
12:14:24.124 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.124 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.125 [DEBUG - pool-102-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.125 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.126 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.126 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.126 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.126 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.127 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.327 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.327 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.327 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.329 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.329 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.329 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.329 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.329 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.329 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:24.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512864392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:24.402 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:24.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:14:24.459 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:24.460 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:24.460 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:24.460 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.460 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.461 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.461 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.461 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:24.466 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:24.467 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:24.467 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:24.467 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.467 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.467 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:24.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:24.468 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.468 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.468 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:24.468 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:24.544 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.544 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.545 [DEBUG - pool-108-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.545 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.545 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.545 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.545 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.546 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.546 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28849), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [32ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [32ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [51ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [51ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [51ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [63ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [88ms] refreshing cache from master, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [89ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [90ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [90ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [91ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [112ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [227ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [228ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [304ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [305ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [923ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [923ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [924ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [924ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2000ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2003ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3761ms] refreshing cache from master, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3763ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3763ms] too many traces: truncated at 100 traces, deferred=Deferred@1453464390(state=PENDING, result=null, callback=(continuation of Deferred@296802145 after retry RPC after error@310563487) -> (continuation of Deferred@821824413 after retry RPC after error@1992445679) -> (continuation of Deferred@1633584265 after retry RPC after error@1707914263) -> (continuation of Deferred@893184976 after retry RPC after error@1366130350) -> (continuation of Deferred@1149420230 after retry RPC after error@1148107341) -> (continuation of Deferred@375307131 after retry RPC after error@754724624) -> (continuation of Deferred@2126138555 after retry RPC after error@1329020403) -> (continuation of Deferred@743555597 after retry RPC after error@1629023288) -> (continuation of Deferred@1307294516 after retry RPC after error@994435039) -> (continuation of Deferred@430318352 after retry RPC after error@1073313072) -> (continuation of Deferred@794516448 after retry RPC after error@980800243) -> (continuation of Deferred@316917774 after retry RPC after error@1715957655) -> (continuation of Deferred@330738916 after retry RPC after error@130029099) -> (continuation of Deferred@191827301 after retry RPC after error@1451876424) -> (continuation of Deferred@1887348721 after retry RPC after error@1997047451) -> (continuation of Deferred@75479354 after retry RPC after error@493716061) -> (continuation of Deferred@405401390 after retry RPC after error@732335854) -> (continuation of Deferred@1382630601 after retry RPC after error@593972147) -> (continuation of Deferred@1952485486 after retry RPC after error@1798218226) -> (continuation of Deferred@1945759570 after retry RPC after error@1784289357) -> (continuation of Deferred@440997512 after retry RPC after error@74847490) -> (continuation of Deferred@952760737 after retry RPC after error@48957061) -> (continuation of Deferred@1355066630 after retry RPC after error@1680763929) -> (continuation of Deferred@333284812 after retry RPC after error@1230534172), errback=(continuation of Deferred@296802145 after retry RPC after error@310563487) -> (continuation of Deferred@821824413 after retry RPC after error@1992445679) -> (continuation of Deferred@1633584265 after retry RPC after error@1707914263) -> (continuation of Deferred@893184976 after retry RPC after error@1366130350) -> (continuation of Deferred@1149420230 after retry RPC after error@1148107341) -> (continuation of Deferred@375307131 after retry RPC after error@754724624) -> (continuation of Deferred@2126138555 after retry RPC after error@1329020403) -> (continuation of Deferred@743555597 after retry RPC after error@1629023288) -> (continuation of Deferred@1307294516 after retry RPC after error@994435039) -> (continuation of Deferred@430318352 after retry RPC after error@1073313072) -> (continuation of Deferred@794516448 after retry RPC after error@980800243) -> (continuation of Deferred@316917774 after retry RPC after error@1715957655) -> (continuation of Deferred@330738916 after retry RPC after error@130029099) -> (continuation of Deferred@191827301 after retry RPC after error@1451876424) -> (continuation of Deferred@1887348721 after retry RPC after error@1997047451) -> (continuation of Deferred@75479354 after retry RPC after error@493716061) -> (continuation of Deferred@405401390 after retry RPC after error@732335854) -> (continuation of Deferred@1382630601 after retry RPC after error@593972147) -> (continuation of Deferred@1952485486 after retry RPC after error@1798218226) -> (continuation of Deferred@1945759570 after retry RPC after error@1784289357) -> (continuation of Deferred@440997512 after retry RPC after error@74847490) -> (continuation of Deferred@952760737 after retry RPC after error@48957061) -> (continuation of Deferred@1355066630 after retry RPC after error@1680763929) -> (continuation of Deferred@333284812 after retry RPC after error@1230534172)))
12:14:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:23.131888 18044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.535357 18042 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 18034
12:14:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.621229 18034 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.492s	user 0.598s	sys 0.860s
12:14:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.622363 18034 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.493s	user 0.598s	sys 0.860s
12:14:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.630445 18063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.630599 18034 server_base.cc:1061] running on GCE node
12:14:24.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.631711 18034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:24.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.634246 18034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:24.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.635646 18034 hybrid_clock.cc:648] HybridClock initialized: now 1783512864635604 us; error 34 us; skew 500 ppm
12:14:24.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.636471 18034 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:24.653 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:14:24.654 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:14:24.655 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:14:24.655 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:14:24.655 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
12:14:24.656 [INFO - Thread-30] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:14:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.655891 18034 webserver.cc:533] Webserver started at http://127.17.135.253:34261/ using document root <none> and password file <none>
12:14:24.656 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:14:24.656 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:24.656 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:14:24.656 [DEBUG - Thread-30] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:14:24.656 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
12:14:24.657 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:14:24.657 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:24.657 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
12:14:24.657 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:24.657 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
12:14:24.658 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:14:24.658 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
12:14:24.658 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
12:14:24.658 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:24.658 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:14:24.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.658619 18034 fs_manager.cc:362] Metadata directory not provided
12:14:24.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.659056 18034 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:24.659 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:24.659 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:14:24.659 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:24.659 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
12:14:24.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.659761 18034 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:24.660 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:14:24.660 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:24.660 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
12:14:24.660 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
12:14:24.661 [INFO - Thread-30] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:14:24.661 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:14:24.661 [INFO - Thread-30] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:14:24.661 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78c33098
12:14:24.661 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:24.661 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:24.662 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:14:24.662 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:14:24.662 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
12:14:24.662 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
12:14:24.663 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5b9d0732
12:14:24.663 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:24.663 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
12:14:24.663 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:14:24.663 [DEBUG - Thread-30] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:24.663 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:14:24.664 [INFO - Thread-30] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:24.664 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:14:24.664 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d2b082f
12:14:24.665 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:14:24.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
12:14:24.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
12:14:24.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@455d745b
12:14:24.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.666052 18034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data/instance:
12:14:24.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:24.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3dc28a0ddcb74f38ac32cd3db6002262"
12:14:24.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:24 on dist-test-slave-vcgh"
12:14:24.666 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:24.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:24.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:24.667 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:14:24.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:14:24.667 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:14:24.667 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:14:24.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.667757 18034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal/instance:
12:14:24.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
12:14:24.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3dc28a0ddcb74f38ac32cd3db6002262"
12:14:24.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:24 on dist-test-slave-vcgh"
12:14:24.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
12:14:24.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4bc81934
12:14:24.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:24.668 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:24.669 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:14:24.669 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:14:24.669 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.669 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.671 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c448623
12:14:24.671 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.672 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@440c0651
12:14:24.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.673 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.674 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6fc293b0
12:14:24.674 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:24.676 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:24.676 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:24.676 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:24.676 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:24.677 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:24.679 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:24.679 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.679 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.680 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.680 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.681 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.681 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.681560 18034 fs_manager.cc:696] Time spent creating directory manager: real 0.013s	user 0.004s	sys 0.008s
12:14:24.682 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.682 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.682 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.682 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.683 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.683 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.683 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.684 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.685 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.685 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.685 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.685 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.686 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.686 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.686 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.686 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.687 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.687 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.687 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.688 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.688 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.688 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.688 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.689 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.689205 18092 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:24.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.689 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.689 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.689 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.689 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.690529 18034 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.690879 18034 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3dc28a0ddcb74f38ac32cd3db6002262"
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:24 on dist-test-slave-vcgh"
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.691229 18034 fs_report.cc:389] FS layout report
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data/data
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:24.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:24.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:24.693 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.693 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.693 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.693 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.697 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.699 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.700 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.700 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.701 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.701 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.702 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.704 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.705 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.705 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.705 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.708 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.713 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.713 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.714 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.715 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.715 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.715 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.716 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.716 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.716 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.716 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.716 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.716 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.716 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.717 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.717 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.717 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.717 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.718 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.718 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.718 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.718 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.718 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.718 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.718 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.719 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.719 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.719 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.719 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.719 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.721 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.721 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.721 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.721 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.721 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.722 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.722 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.722 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.722 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.723 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.730 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.730 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.731 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.731 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.731 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.731 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.731 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.731 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.732 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.732 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.732 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.732 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.739 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.740 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.740 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.740 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.740 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.741 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.741 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.741 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.741 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.742 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.742 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.742 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.742 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.742 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.743 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.743 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.743 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.743 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.744 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.744 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.744 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.744 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.747689 18034 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:24.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.749231 18034 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:24.749 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.749 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.749 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.750 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.749751 18034 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:24.750 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.750 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.750 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.750 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.750 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.750 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.750 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.755 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:24.755 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:24.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:24.755 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:24.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:24.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:24.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:24.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:24.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:24.756 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:24.756 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:24.756 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:24.756 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:24.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.759 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.759 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.759 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.759 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.759 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.759 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.759 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.759 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.760 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.760 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.760 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.761 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.761 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.761 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.761 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.761 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.761 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.762 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.762 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.762 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.762 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.762 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.762 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.762 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.761 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.761 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.762 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.762 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.763 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.769 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.769 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.769 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.769 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.769 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.770 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.780 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.780 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.780 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.780 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.780 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.780 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.781 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.781 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.781 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.781 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.781 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.781 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.781 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.781 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.782 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.782 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.782 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.782 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.782 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.782 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.782 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.782 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.782 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.782 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.782 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.782 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.782 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.782 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.782 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.782 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.783 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.783 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.782 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.783 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.783 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.783 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.783 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.783 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.783 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.783 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.784 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.785 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:24.785 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:24.785 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:24.785 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:24.785 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:24.785 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:24.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:24.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:24.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:24.786 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:24.786 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:24.786 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:24.786 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:24.789 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.790 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.790 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.790 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.790 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.790 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.790 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.790 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.790 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.790 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.790 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.790 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.790 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.799 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.800 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.800 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.800 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.800 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.801 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.801 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.801 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.801 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.801 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.801 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.801 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.801 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.820 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.820 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.821 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.821 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.821 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.821 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.821 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.822 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.822 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.822 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.822 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.822 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.822 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.822 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.823 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.824067 18034 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.253:43339
12:14:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.824141 18172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.253:43339 every 8 connection(s)
12:14:24.826 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.826855 18034 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/data/info.pb
12:14:24.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.827 [DEBUG - pool-109-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.828 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.828 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.828 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.828 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.829 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29146), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [9ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [12ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [40ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [41ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [66ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [66ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [66ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [85ms] refreshing cache from master, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [86ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [86ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [87ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [87ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [104ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [202ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [244ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [244ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [500ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [503ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [600ms] refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [601ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [602ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1542ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2240ms] refreshing cache from master, [2240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2243ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2260ms] refreshing cache from master, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2262ms] too many traces: truncated at 100 traces, deferred=Deferred@1265982426(state=PENDING, result=null, callback=(continuation of Deferred@1253272202 after retry RPC after error@1387714272) -> (continuation of Deferred@1290441700 after retry RPC after error@765508136) -> (continuation of Deferred@2090234412 after retry RPC after error@410233480) -> (continuation of Deferred@1998801 after retry RPC after error@684188672) -> (continuation of Deferred@1729098790 after retry RPC after error@1647125925) -> (continuation of Deferred@297676486 after retry RPC after error@105791253) -> (continuation of Deferred@511198526 after retry RPC after error@368266073) -> (continuation of Deferred@1968934719 after retry RPC after error@35303446) -> (continuation of Deferred@1586975966 after retry RPC after error@1362191830) -> (continuation of Deferred@2017077944 after retry RPC after error@796372905) -> (continuation of Deferred@1260535613 after retry RPC after error@292027482) -> (continuation of Deferred@941718308 after retry RPC after error@716804462) -> (continuation of Deferred@1882753235 after retry RPC after error@1586708386) -> (continuation of Deferred@1834518287 after retry RPC after error@185354539) -> (continuation of Deferred@1061566089 after retry RPC after error@2020565228) -> (continuation of Deferred@1361502225 after retry RPC after error@948612623) -> (continuation of Deferred@922101225 after retry RPC after error@891116507) -> (continuation of Deferred@1406997249 after retry RPC after error@1045046691) -> (continuation of Deferred@966035182 after retry RPC after error@1720242564) -> (continuation of Deferred@1576436559 after retry RPC after error@847172207) -> (continuation of Deferred@801149240 after retry RPC after error@266629557) -> (continuation of Deferred@1726052349 after retry RPC after error@575159524) -> (continuation of Deferred@162144452 after retry RPC after error@628064669) -> (continuation of Deferred@1214006354 after retry RPC after error@730922657) -> (continuation of Deferred@1944344343 after retry RPC after error@719209375) -> (continuation of Deferred@719938 after retry RPC after error@751005460) -> (continuation of Deferred@2102315380 after retry RPC after error@634699769) -> (continuation of Deferred@1919664109 after retry RPC after error@1164428667) -> (continuation of Deferred@1315549642 after retry RPC after error@1321399433), errback=(continuation of Deferred@1253272202 after retry RPC after error@1387714272) -> (continuation of Deferred@1290441700 after retry RPC after error@765508136) -> (continuation of Deferred@2090234412 after retry RPC after error@410233480) -> (continuation of Deferred@1998801 after retry RPC after error@684188672) -> (continuation of Deferred@1729098790 after retry RPC after error@1647125925) -> (continuation of Deferred@297676486 after retry RPC after error@105791253) -> (continuation of Deferred@511198526 after retry RPC after error@368266073) -> (continuation of Deferred@1968934719 after retry RPC after error@35303446) -> (continuation of Deferred@1586975966 after retry RPC after error@1362191830) -> (continuation of Deferred@2017077944 after retry RPC after error@796372905) -> (continuation of Deferred@1260535613 after retry RPC after error@292027482) -> (continuation of Deferred@941718308 after retry RPC after error@716804462) -> (continuation of Deferred@1882753235 after retry RPC after error@1586708386) -> (continuation of Deferred@1834518287 after retry RPC after error@185354539) -> (continuation of Deferred@1061566089 after retry RPC after error@2020565228) -> (continuation of Deferred@1361502225 after retry RPC after error@948612623) -> (continuation of Deferred@922101225 after retry RPC after error@891116507) -> (continuation of Deferred@1406997249 after retry RPC after error@1045046691) -> (continuation of Deferred@966035182 after retry RPC after error@1720242564) -> (continuation of Deferred@1576436559 after retry RPC after error@847172207) -> (continuation of Deferred@801149240 after retry RPC after error@266629557) -> (continuation of Deferred@1726052349 after retry RPC after error@575159524) -> (continuation of Deferred@162144452 after retry RPC after error@628064669) -> (continuation of Deferred@1214006354 after retry RPC after error@730922657) -> (continuation of Deferred@1944344343 after retry RPC after error@719209375) -> (continuation of Deferred@719938 after retry RPC after error@751005460) -> (continuation of Deferred@2102315380 after retry RPC after error@634699769) -> (continuation of Deferred@1919664109 after retry RPC after error@1164428667) -> (continuation of Deferred@1315549642 after retry RPC after error@1321399433)))
12:14:24.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.833317 18173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:24.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:24.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.835822 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 18034
12:14:24.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.836277 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-1/wal/instance
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.839008 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/logs
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data/info.pb
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.252:38447
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.252
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json with env {}
12:14:24.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.846647 18173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } has no permanent_uuid. Determining permanent_uuid...
12:14:24.849 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.850 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.850 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.860 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.860 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.860 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.860 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.860 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.860 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.860 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.860 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.860 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.861 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.861 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.861 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.861 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.860 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.861 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.861 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.861 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.862 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.862 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.862 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.862 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.862 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.863 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.863 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.863 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.863 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.863 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.863 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.864 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.864 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.864 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.872787 18173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } has no permanent_uuid. Determining permanent_uuid...
12:14:24.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.886530 18173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } has no permanent_uuid. Determining permanent_uuid...
12:14:24.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.888967 18119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:24.890 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.890 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.890 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.891 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.891 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.891 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.891 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.892 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512864892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:24.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.893208 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:24.901 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:24.901 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:14:24.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:24.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:24.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:24.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.922 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.922 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:24.922 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:24.922 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.922 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:24.922 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:24.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.940 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.940 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.940 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.941 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.941 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.941 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.941 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.941 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.941 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.941 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.941 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.941 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.941 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:24.942729 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 1
12:14:24.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:24.946699 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:24.981 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.982 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.982 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.982 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.982 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.982 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.982 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.982 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.982 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.982 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.982 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:24.989 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:24.989 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:24.990 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:24.990 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.990 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.990 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:24.990 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.990 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.990 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:24.990 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.990 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:24.990 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.015046 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 2
12:14:25.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.019286 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.020 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.021 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.021 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.021 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.022 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.096619 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } attempt: 7
12:14:25.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.107985 18032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } has no permanent_uuid. Determining permanent_uuid...
12:14:25.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.110711 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 3
12:14:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.115154 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.115226 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:25.140 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.140 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.140 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.141 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.141 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.141 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.160 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:25.161 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:25.161 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:25.161 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.161 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.161 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.161 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.161 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.161 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.161 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.162 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:25.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.171662 18175 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:25.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.172303 18175 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:25.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.172909 18175 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:25.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.173626 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 1
12:14:25.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.180076 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.220346 18175 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:25.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.220738 18175 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:25.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.221055 18175 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:25.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.221381 18175 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:25.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.221673 18175 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:25.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.221885 18175 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33147/jwks.json
12:14:25.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:25.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:25.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:25.241 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.241 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.241 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.241 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.241 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.242 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.242 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.258626 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 4
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.259483 18175 master_runner.cc:387] Master server non-default flags:
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data
12:14:25.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.252:38447
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33147/jwks.json
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data/info.pb
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.252
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/logs
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:25.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:25.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.261025 18175 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:25.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.261519 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 2
12:14:25.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.262876 18175 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:25.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.263186 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.265758 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.273614 18187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:25.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:25.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.351132 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 3
12:14:25.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.356376 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.361 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:25.362 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:25.362 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:25.362 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.362 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.362 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:25.362 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:25.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:25.362 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:25.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512865392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:25.400 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:14:25.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:14:25.430 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.430 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.430 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.431 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.431 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.431 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.431 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.431 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.431 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.440 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.441 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.441 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.441 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.441 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.442 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.481 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.481 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.481 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.482 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.482 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.482 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.482 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.482 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.496804 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 4
12:14:25.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.500991 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.519 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.519 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.520 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.520 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.520 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.520 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.520 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.520 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:25.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.562593 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 5
12:14:25.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.567164 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:25.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:25.784493 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 5
12:14:25.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.789891 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:25.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:25.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512865892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:25.900 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:25.901 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:14:25.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:25.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:25.939 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:25.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:25.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:25.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:25.940 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:26.069 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:26.070 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:26.070 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:26.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.070 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.070 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.070 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.071 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.071 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:26.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.114645 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 6
12:14:26.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:26.121 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:26.121 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:26.121 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:26.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:26.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.123394 18173 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:26.219 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:26.220 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:26.220 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:26.220 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.220 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.220 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.221 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:26.280 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:26.280 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:26.280 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:26.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.280 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.281 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.281 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.281 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.281 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:26.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:26.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.342347 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 6
12:14:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.351178 18032 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.17.135.252:38447: Network error: Client connection negotiation failed: client connection to 127.17.135.252:38447: connect: Connection refused (error 111)
12:14:26.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512866392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:26.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:14:26.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:14:26.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.275753 18188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:26.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:25.278074 18190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:26.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.431110 18189 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1156 milliseconds
12:14:26.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.431161 18175 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.435369 18175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:26.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.437832 18175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:26.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.439153 18175 hybrid_clock.cc:648] HybridClock initialized: now 1783512866439115 us; error 60 us; skew 500 ppm
12:14:26.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.440058 18175 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:26.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.457185 18175 webserver.cc:533] Webserver started at http://127.17.135.252:32863/ using document root <none> and password file <none>
12:14:26.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.458647 18175 fs_manager.cc:362] Metadata directory not provided
12:14:26.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.459066 18175 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:26.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.459743 18175 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:26.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.466310 18175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data/instance:
12:14:26.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2979747c46f74287ae6fc30bbc08fc54"
12:14:26.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:26 on dist-test-slave-vcgh"
12:14:26.467 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:26.467 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:26.467 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:26.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.468 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.468 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.468 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.468 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.468 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.468 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.468 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.469223 18175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal/instance:
12:14:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2979747c46f74287ae6fc30bbc08fc54"
12:14:26.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:26 on dist-test-slave-vcgh"
12:14:26.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.476584 18175 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
12:14:26.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.482429 18202 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:26.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.483485 18175 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.483755 18175 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2979747c46f74287ae6fc30bbc08fc54"
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:26 on dist-test-slave-vcgh"
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.484052 18175 fs_report.cc:389] FS layout report
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data/data
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:26.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.537958 18175 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.539322 18175 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.539707 18175 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:26.547 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:26.547 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:26.547 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:26.547 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.547 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.547 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.547 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.548 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.548 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.548 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.548 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.548 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.548 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:26.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.615362 18175 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.252:38447
12:14:26.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.615453 18254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.252:38447 every 8 connection(s)
12:14:26.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:26.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.618062 18175 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/data/info.pb
12:14:26.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.620955 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 18175
12:14:26.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.621419 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/master-2/wal/instance
12:14:26.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.624656 18255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:26.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.640614 18255 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } has no permanent_uuid. Determining permanent_uuid...
12:14:26.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.668754 18255 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } has no permanent_uuid. Determining permanent_uuid...
12:14:26.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.680130 18255 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } has no permanent_uuid. Determining permanent_uuid...
12:14:26.681 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:26.682 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:26.682 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:26.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.682 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.682 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:26.683 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.683 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.683 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:26.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:26.683 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:26.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.696256 18255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: Bootstrap starting.
12:14:26.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.704056 18255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: Neither blocks nor log segments found. Creating new log.
12:14:26.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.706284 18255 log.cc:826] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: Log is configured to *not* fsync() on all Append() calls
12:14:26.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.711282 18255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: No bootstrap required, opened a new log
12:14:26.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.732924 18255 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:26.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.733551 18255 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:26.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.733731 18255 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2979747c46f74287ae6fc30bbc08fc54, State: Initialized, Role: FOLLOWER
12:14:26.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.734515 18255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:26.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.737363 18265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:26.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.738155 18265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: This master's current role is: FOLLOWER
12:14:26.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.739104 18255 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: configured and running, proceeding with master startup.
12:14:26.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.763744 18276 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:26.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.764084 18276 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:26.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.759479 18175 master_runner.cc:187] Error getting master registration for 127.17.135.254:37603: OK, instance_id { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" instance_seqno: 1783512862676560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:26.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.782428 18175 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:26.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:26.795428 18209 tablet.cc:2406] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:26.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:26.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:26.827 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:26.828 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.828 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.828 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.828 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.828 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:26.828 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:26.828 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:26.829 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:26.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:26.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.855018 18265 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:26.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.855630 18265 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:26.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:26.858807 18265 leader_election.cc:290] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 461bcb2a5da74be2a0508b9acd127405 (127.17.135.254:37603), 3dc28a0ddcb74f38ac32cd3db6002262 (127.17.135.253:43339)
12:14:26.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512866892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:26.907 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:26.908 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:14:27.047 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:27.048 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:27.048 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:27.048 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.048 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.048 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.048 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.048 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.048 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.049 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.049 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:27.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:27.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.183848 18173 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 7
12:14:27.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.205914 18173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: Bootstrap starting.
12:14:27.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.211724 18173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: Neither blocks nor log segments found. Creating new log.
12:14:27.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.213542 18173 log.cc:826] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: Log is configured to *not* fsync() on all Append() calls
12:14:27.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.218003 18173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: No bootstrap required, opened a new log
12:14:27.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.236634 18173 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.237478 18173 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:27.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.237775 18173 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc28a0ddcb74f38ac32cd3db6002262, State: Initialized, Role: FOLLOWER
12:14:27.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.238670 18173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:27.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:27.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:27.241 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:27.241 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:27.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:27.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:27.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:27.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:27.241 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:27.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:27.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:27.242 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.242653 18280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.243577 18280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.244364 18173 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: configured and running, proceeding with master startup.
12:14:27.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.244585 18148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2979747c46f74287ae6fc30bbc08fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" is_pre_election: true
12:14:27.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.245450 18148 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2979747c46f74287ae6fc30bbc08fc54 in term 0.
12:14:27.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.246855 18205 leader_election.cc:304] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2979747c46f74287ae6fc30bbc08fc54, 3dc28a0ddcb74f38ac32cd3db6002262; no voters: 
12:14:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.247828 18265 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.248186 18265 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.248487 18265 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 0 FOLLOWER]: Advancing to term 1
12:14:27.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.255540 18265 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:27.257542 18127 tablet.cc:2406] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:27.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.260079 18148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2979747c46f74287ae6fc30bbc08fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc28a0ddcb74f38ac32cd3db6002262"
12:14:27.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.260600 18148 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 0 FOLLOWER]: Advancing to term 1
12:14:27.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.259516 18265 leader_election.cc:290] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [CANDIDATE]: Term 1 election: Requested vote from peers 461bcb2a5da74be2a0508b9acd127405 (127.17.135.254:37603), 3dc28a0ddcb74f38ac32cd3db6002262 (127.17.135.253:43339)
12:14:27.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.270994 18148 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2979747c46f74287ae6fc30bbc08fc54 in term 1.
12:14:27.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.277719 18205 leader_election.cc:304] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2979747c46f74287ae6fc30bbc08fc54, 3dc28a0ddcb74f38ac32cd3db6002262; no voters: 
12:14:27.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.279537 18265 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 1 FOLLOWER]: Leader election won for term 1
12:14:27.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.284489 18265 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [term 1 LEADER]: Becoming Leader. State: Replica: 2979747c46f74287ae6fc30bbc08fc54, State: Running, Role: LEADER
12:14:27.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.285697 18265 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.314806 18284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2979747c46f74287ae6fc30bbc08fc54. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.316058 18284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: This master's current role is: LEADER
12:14:27.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.319875 18290 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:14:27.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:27.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:27.336402 18294 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:27.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:27.336912 18294 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:27.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.345355 18290 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:14:27.371 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:27.371 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:27.371 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:27.371 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.372 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.372 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.372 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.372 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.372 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.373 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.373 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:27.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.373787 18148 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [term 1 FOLLOWER]: Refusing update from remote peer 2979747c46f74287ae6fc30bbc08fc54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:27.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.375536 18284 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:27.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.384593 18032 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } attempt: 7
12:14:27.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512867391 for job c0988648dfcd43275159a42b4d64d13e.
12:14:27.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.331358 18034 master_runner.cc:187] Error getting master registration for 127.17.135.254:37603: OK, instance_id { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" instance_seqno: 1783512862676560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:27.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.400022 18034 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:27.406 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:14:27.407 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:14:27.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.437206 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: Bootstrap starting.
12:14:27.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.453300 18032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: Neither blocks nor log segments found. Creating new log.
12:14:27.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.459832 18032 log.cc:826] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: Log is configured to *not* fsync() on all Append() calls
12:14:27.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.470985 18032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: No bootstrap required, opened a new log
12:14:27.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.482281 18280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2979747c46f74287ae6fc30bbc08fc54. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.483037 18280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.495815 18298 mvcc.cc:204] Tried to move back new op lower bound from 7305268704741838848 to 7305268704421269504. Current Snapshot: MvccSnapshot[applied={T|T < 7305268704741838848}]
12:14:27.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.503005 18290 catalog_manager.cc:1383] Generated new cluster ID: cfee84a4c84e41e1ac2e0f7625fd2758
12:14:27.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.503307 18290 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:14:27.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.503705 18265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.504374 18265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: This master's current role is: LEADER
12:14:27.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.514963 18280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.515672 18280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.528345 18032 raft_consensus.cc:359] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.529290 18032 raft_consensus.cc:385] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:27.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.529567 18032 raft_consensus.cc:740] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 461bcb2a5da74be2a0508b9acd127405, State: Initialized, Role: FOLLOWER
12:14:27.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.530608 18032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } }
12:14:27.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.543030 18290 catalog_manager.cc:1406] Generated new certificate authority record
12:14:27.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.544963 18290 catalog_manager.cc:1540] Loading token signing keys...
12:14:27.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.562268 18303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.572479 18007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2979747c46f74287ae6fc30bbc08fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "461bcb2a5da74be2a0508b9acd127405" is_pre_election: true
12:14:27.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.573412 18006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2979747c46f74287ae6fc30bbc08fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "461bcb2a5da74be2a0508b9acd127405"
12:14:27.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.582360 18005 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [term 0 FOLLOWER]: Advancing to term 1
12:14:27.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.588763 18032 sys_catalog.cc:565] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: configured and running, proceeding with master startup.
12:14:27.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.590848 18303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.591883 18005 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [term 1 FOLLOWER]: Refusing update from remote peer 2979747c46f74287ae6fc30bbc08fc54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.595350 18284 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:27.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.596953 18290 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: Generated new TSK 0
12:14:27.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.598009 18290 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:14:27.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:27.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.626412 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:27.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/logs
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data/info.pb
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.193:0
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.193
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.193
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:27.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:27.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:27.627724 17986 tablet.cc:2406] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.655326 18307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.656131 18307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.657194 18303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2979747c46f74287ae6fc30bbc08fc54. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.657830 18303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405 [sys.catalog]: This master's current role is: FOLLOWER
12:14:27.671 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:27.671 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:27.671 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:27.672 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.672 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.672 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.672 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.673 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.673 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.673 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.673 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.673 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:27.699 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:27.700 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:27.700 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:27.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.701 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.701 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:27.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.701 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:27.701 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:27.702 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:27.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:27.720316 18320 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:14:27.740 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:27.740 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:27.740 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:27.741 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:27.741 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.741 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.741 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:27.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:27.742 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:27.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:27.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512867892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:27.903 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:14:27.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:14:28.000 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:28.000 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:28.000 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:28.001 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.001 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.001 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.001 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.002 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.002 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.002 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.002 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.002 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.002 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:28.005 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:28.005 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:28.006 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:28.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:28.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:28.006 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:28.006 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:28.006 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:28.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:28.007 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:28.007 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:28.007 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:28.007 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:28.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.021502 18284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2979747c46f74287ae6fc30bbc08fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "461bcb2a5da74be2a0508b9acd127405" member_type: VOTER last_known_addr { host: "127.17.135.254" port: 37603 } } peers { permanent_uuid: "3dc28a0ddcb74f38ac32cd3db6002262" member_type: VOTER last_known_addr { host: "127.17.135.253" port: 43339 } } peers { permanent_uuid: "2979747c46f74287ae6fc30bbc08fc54" member_type: VOTER last_known_addr { host: "127.17.135.252" port: 38447 } } }
12:14:28.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.022235 18284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54 [sys.catalog]: This master's current role is: LEADER
12:14:28.041 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:28.041 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:28.041 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:28.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.043 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:28.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:28.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:28.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:28.147 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:28.148 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.148 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.148 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.148 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.149 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:28.187 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:28.187 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:28.187 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:28.188 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.188 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.188 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:28.189 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.189 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.189 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:28.189 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.189 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:28.189 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:28.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:28.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:28.241 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:28.242 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.242 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.242 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:28.242 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.242 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.242 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:28.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:28.243 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:28.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.243040 18309 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:28.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.243664 18309 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:28.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.244395 18309 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:28.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.304390 18309 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:28.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.305778 18309 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.135.193
12:14:28.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:28.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:28.315 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:28.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:28.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:28.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:28.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:28.316 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:28.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:28.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:28.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:28.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:28.316 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:28.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.343343 18294 catalog_manager.cc:1295] Loaded cluster ID: cfee84a4c84e41e1ac2e0f7625fd2758
12:14:28.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.343865 18294 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: loading cluster ID for follower catalog manager: success
12:14:28.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.359217 18294 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: acquiring CA information for follower catalog manager: success
12:14:28.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.365447 18294 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 3dc28a0ddcb74f38ac32cd3db6002262: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.369845 18309 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.193:0
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data/info.pb
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.193
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.193
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/logs
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:28.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:28.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.371481 18309 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:28.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.373603 18309 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:28.380 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:28.380 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:28.380 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:28.381 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.381 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.381 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.381 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.381 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.381 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.382 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.382 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.382 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:28.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512868392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:28.405 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:14:28.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:14:28.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.430105 18327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:28.560 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:28.561 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:28.561 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:28.561 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.562 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.562 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:28.562 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.562 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.562 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:28.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:28.563 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:28.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:28.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.737617 18320 catalog_manager.cc:1295] Loaded cluster ID: cfee84a4c84e41e1ac2e0f7625fd2758
12:14:28.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.739758 18320 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: loading cluster ID for follower catalog manager: success
12:14:28.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.754707 18320 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: acquiring CA information for follower catalog manager: success
12:14:28.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.768563 18320 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 461bcb2a5da74be2a0508b9acd127405: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:28.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:28.892 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512868892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:28.902 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:28.903 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:14:29.081 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:29.081 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:29.081 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:29.082 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.082 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.083 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.083 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.083 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.083 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.083 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.083 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.083 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:29.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:29.319 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:29.319 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:29.319 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:29.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.321 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:29.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:29.339 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:29.339 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:29.339 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:29.340 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:29.340 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:29.340 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:29.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:29.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:29.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:29.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:29.341 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:29.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:29.341 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:29.392 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512869392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:29.401 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:29.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:14:29.500 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:29.501 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:29.501 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:29.502 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.502 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.502 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:29.502 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.502 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.502 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:29.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:29.503 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:29.601 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:29.601 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:29.602 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:29.602 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:29.602 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:29.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:29.603 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:29.603 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:29.603 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:29.603 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:29.603 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:29.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:29.603 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:29.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:29.840 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:29.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.448881 18331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:29.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:28.441591 18309 server_base.cc:1061] running on GCE node
12:14:29.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:28.441171 18328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.885628 18309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:29.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512869892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:29.902 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:14:29.904 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:14:29.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.904367 18309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:29.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.907409 18309 hybrid_clock.cc:648] HybridClock initialized: now 1783512869907365 us; error 50 us; skew 500 ppm
12:14:29.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.908633 18309 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:29.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.917837 18309 webserver.cc:533] Webserver started at http://127.17.135.193:42075/ using document root <none> and password file <none>
12:14:29.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.919049 18309 fs_manager.cc:362] Metadata directory not provided
12:14:29.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.919345 18309 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:29.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.919902 18309 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:29.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.926002 18309 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data/instance:
12:14:29.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:29.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:29 on dist-test-slave-vcgh"
12:14:29.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.927433 18309 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal/instance:
12:14:29.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:29.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:29 on dist-test-slave-vcgh"
12:14:29.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.936975 18309 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
12:14:29.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.946988 18341 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:29.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.948521 18309 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.001s	sys 0.004s
12:14:29.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.948976 18309 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal
12:14:29.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:29.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:29 on dist-test-slave-vcgh"
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:29.949400 18309 fs_report.cc:389] FS layout report
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data/data
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:30.015 [DEBUG - pool-120-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [4ms] received response from server master-127.14.239.124:41311: OK, deferred=null) with no deferred attached!
12:14:30.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.016564 18309 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:30.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.018555 18309 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:30.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.019112 18309 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:30.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.022650 18309 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:30.026 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:30.027 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:30.027 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:30.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:30.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:30.028 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:30.028 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:30.028 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:30.028 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:30.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:30.029 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:30.029 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:30.029 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:30.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.030786 18309 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:30.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.031059 18309 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:30.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.031364 18309 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:30.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.031569 18309 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:30.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:30.160 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:30.160 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:30.160 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:30.161 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.161 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.161 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.162 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:30.281 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:30.281 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:30.281 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:30.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.281 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.281 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.282 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.282 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.282 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.282 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:30.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.286996 18309 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.193:45465
12:14:30.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.287184 18453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.193:45465 every 8 connection(s)
12:14:30.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.290561 18309 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/data/info.pb
12:14:30.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.298735 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 18309
12:14:30.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.299183 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-0/wal/instance
12:14:30.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.326447 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:30.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/logs
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data/info.pb
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.194:0
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.194
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.194
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:30.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:30.341 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:30.342 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:30.342 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:30.342 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.342 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:30.343 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.343 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.343 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:30.343 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.343 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.343 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:30.343 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:30.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.355202 18455 heartbeater.cc:344] Connected to a master server at 127.17.135.253:43339
12:14:30.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.355726 18454 heartbeater.cc:344] Connected to a master server at 127.17.135.252:38447
12:14:30.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.355787 18455 heartbeater.cc:461] Registering TS with master...
12:14:30.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.357290 18455 heartbeater.cc:507] Master 127.17.135.253:43339 requested a full tablet report, sending...
12:14:30.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.358709 18454 heartbeater.cc:461] Registering TS with master...
12:14:30.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.359580 18454 heartbeater.cc:507] Master 127.17.135.252:38447 requested a full tablet report, sending...
12:14:30.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.362043 18220 ts_manager.cc:194] Registered new tserver with Master: 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465)
12:14:30.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.362159 18138 ts_manager.cc:194] Registered new tserver with Master: 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465)
12:14:30.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.364256 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.135.193:56585
12:14:30.366 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:30.367 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:30.367 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:30.367 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.367 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.367 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.368 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.368 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:30.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.374151 18458 heartbeater.cc:344] Connected to a master server at 127.17.135.254:37603
12:14:30.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.374501 18458 heartbeater.cc:461] Registering TS with master...
12:14:30.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.375111 18458 heartbeater.cc:507] Master 127.17.135.254:37603 requested a full tablet report, sending...
12:14:30.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.378159 17997 ts_manager.cc:194] Registered new tserver with Master: 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465)
12:14:30.386 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:30.387 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:30.387 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:30.387 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.387 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.387 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.387 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.387 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.388 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:30.393 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512870392 for job c0988648dfcd43275159a42b4d64d13e.
12:14:30.402 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:30.403 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:14:30.545 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [7ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.545 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [21ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.545 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [32ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.545 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [31ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.546 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [32ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.546 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [31ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.546 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [29ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.546 [DEBUG - pool-124-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.15.167.188:40073, [28ms] received response from server master-127.15.167.188:40073: OK, deferred=null) with no deferred attached!
12:14:30.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:30.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.764859 18464 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:30.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.766172 18464 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:30.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.766961 18464 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:30.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.804122 18464 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:30.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.805347 18464 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.135.194
12:14:30.807 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:30.807 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:30.808 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:30.808 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.808 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.808 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.808 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.808 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.808 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.808 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.808 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.808 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:30.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.846215 18464 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.194:0
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data/info.pb
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.194
12:14:30.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.194
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/logs
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:30.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:30.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.847784 18464 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:30.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:30.849562 18464 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:30.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.870312 18473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:30.891 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:30.892 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:30.892 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:30.892 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.893 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.893 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.893 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.893 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:30.893 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:30.893 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512870892 for job c0988648dfcd43275159a42b4d64d13e.
12:14:30.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:30.897 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:30.904 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job c0988648dfcd43275159a42b4d64d13e (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:14:30.906 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:14:31.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:31.155 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.155 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.155 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.156 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.156 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.156 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.156 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.156 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.157 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.157 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.157 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.157 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.157 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.158 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27223), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [1ms] received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [24ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2083ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4840ms] refreshing cache from master, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [4842ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4842ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [5321ms] refreshing cache from master, [5321ms] too many traces: truncated at 100 traces, deferred=Deferred@1989014161(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@56b703b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712)))
12:14:31.159 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.159 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.159 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.159 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27223), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [1ms] received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [24ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2083ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4840ms] refreshing cache from master, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [4842ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4842ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [5321ms] refreshing cache from master, [5321ms] too many traces: truncated at 100 traces, deferred=Deferred@1989014161(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@56b703b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27223), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [1ms] received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [24ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2083ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4840ms] refreshing cache from master, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [4842ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4842ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [5321ms] refreshing cache from master, [5321ms] too many traces: truncated at 100 traces, deferred=Deferred@1989014161(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@56b703b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:31.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.161 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.162 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.162 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.162 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.165 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27223), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [1ms] received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [24ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2083ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4840ms] refreshing cache from master, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [4842ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4842ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [5321ms] refreshing cache from master, [5321ms] too many traces: truncated at 100 traces, deferred=Deferred@1989014161(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@56b703b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=24, TimeoutTracker(timeout=30000, elapsed=27223), Traces: [0ms] sending RPC to server master-127.14.239.124:41311, [1ms] received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [23ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [24ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [24ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [42ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [43ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [302ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [303ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [303ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [383ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [383ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2083ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2083ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4840ms] refreshing cache from master, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [4841ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [4842ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4842ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [5321ms] refreshing cache from master, [5321ms] too many traces: truncated at 100 traces, deferred=Deferred@1989014161(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@56b703b2 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@560424810 after retry RPC after error@247998046) -> (continuation of Deferred@390616172 after retry RPC after error@2030858148) -> (continuation of Deferred@1665801176 after retry RPC after error@746531641) -> (continuation of Deferred@2042753518 after retry RPC after error@1663746109) -> (continuation of Deferred@1343066971 after retry RPC after error@100555904) -> (continuation of Deferred@1942389584 after retry RPC after error@1180212797) -> (continuation of Deferred@2062764774 after retry RPC after error@228459364) -> (continuation of Deferred@1250286980 after retry RPC after error@1219369887) -> (continuation of Deferred@686476310 after retry RPC after error@1435664204) -> (continuation of Deferred@824172935 after retry RPC after error@156591832) -> (continuation of Deferred@1998684568 after retry RPC after error@831518767) -> (continuation of Deferred@2144478272 after retry RPC after error@1569980100) -> (continuation of Deferred@650480047 after retry RPC after error@1749373912) -> (continuation of Deferred@115051188 after retry RPC after error@1157378421) -> (continuation of Deferred@1325285556 after retry RPC after error@208081184) -> (continuation of Deferred@1446224946 after retry RPC after error@1944141848) -> (continuation of Deferred@1327908144 after retry RPC after error@2071765989) -> (continuation of Deferred@816155276 after retry RPC after error@1237187840) -> (continuation of Deferred@877608642 after retry RPC after error@716357669) -> (continuation of Deferred@920641045 after retry RPC after error@271343667) -> (continuation of Deferred@1566111194 after retry RPC after error@1633138108) -> (continuation of Deferred@691069173 after retry RPC after error@1517170712)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:31.165 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:14:31.165 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RUNNING to RESTARTING.
12:14:31.166 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:31.166 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:31.166 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
12:14:31.166 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:14:31.166 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:31.167 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:14:31.167 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:14:31.167 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:14:31.167 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:31.167 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:31.167 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:31.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
12:14:31.167 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:14:31.167 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:31.167 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:31.167 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:14:31.167 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:31.167 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:14:31.168 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:14:31.168 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:14:31.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:31.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:31.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:31.168 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:31.175 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.176 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.176 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.178 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.178 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.178 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.179 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.193 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state TERMINATED
12:14:31.193 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state TERMINATED
12:14:31.193 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state TERMINATED
12:14:31.193 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:31.194 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:14:31.194 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.195 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.195 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.195 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.195 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.196 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.197 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.197 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.197 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.197 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:14:31.209 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:14:31.209 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:14:31.209 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:14:31.210 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state TERMINATED
12:14:31.211 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state TERMINATED
12:14:31.211 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state TERMINATED
12:14:31.211 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:31.211 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:31.212 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:14:31.215 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.216 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.216 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.217 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.217 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.217 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.217 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.217 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.217 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.218 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.219 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:31.219 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:31.220 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:31.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.221 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:31.223 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:14:31.223 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:14:31.223 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:14:31.233 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state TERMINATED
12:14:31.233 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state TERMINATED
12:14:31.233 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer b6281af7c1bc4e3d9e516eac6adeaf1f(127.15.167.129:41401)] disconnecting while in state TERMINATED
12:14:31.233 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state TERMINATED
12:14:31.233 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:31.234 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:14:31.234 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
12:14:31.235 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:14:31.235 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.236 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.236 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.243 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:14:31.243 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:14:31.243 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:14:31.253 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.15.167.189:34023(127.15.167.189:34023)] disconnecting while in state TERMINATED
12:14:31.254 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.15.167.188:40073(127.15.167.188:40073)] disconnecting while in state TERMINATED
12:14:31.254 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.15.167.190:46157(127.15.167.190:46157)] disconnecting while in state TERMINATED
12:14:31.254 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:31.255 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:14:31.255 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:14:31.264 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:14:31.264 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-1
12:14:31.264 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:14:31.264 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:14:31.275 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.276 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.276 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.278 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.278 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.278 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.278 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.278 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.278 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.278 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.294 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.295 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.295 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.296 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.296 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.296 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.296 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.296 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.296 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.297 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.297 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.297 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.297 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.317 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
12:14:31.318 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:14:31.319 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:31.330 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:14:31.330 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:31.331 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:14:31.331 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:14:31.332 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:14:31.332 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:14:31.333 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:31.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:31.340 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:31.341 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:14:31.341 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:14:31.341 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:14:31.342 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
12:14:31.342 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:14:31.343 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:31.345 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:14:31.345 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:14:31.346 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:14:31.346 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:14:31.346 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:14:31.347 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:14:31.347 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c0988648dfcd43275159a42b4d64d13e
12:14:31.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:31.371547 18454 heartbeater.cc:499] Master 127.17.135.252:38447 was elected leader, sending a full tablet report...
12:14:31.375 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.375 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.375 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.376 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.376 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.377 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.378 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.378 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.378 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.449 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:31.450 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:31.450 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:31.450 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.450 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.450 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.451 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.451 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.451 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.451 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:31.535 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.535 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.535 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.535 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.535 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.536 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.536 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.536 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.536 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.536 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.587 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:31.588 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:31.588 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:31.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.589 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.589 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.589 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.589 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.590 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:31.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:31.635 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:31.636 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:31.636 [DEBUG - pool-120-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:31.636 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.636 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.636 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:31.637 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.637 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.637 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:31.637 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.637 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:31.637 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:31.739 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:31.739 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:31.739 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:31.739 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.739 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:31.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:31.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.741 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.741 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:31.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:31.741 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:31.741 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:31.742 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:31.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.743 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.743 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.743 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:31.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:31.940 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:31.940 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:31.941 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:31.941 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.941 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.942 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:31.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.942 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.942 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:31.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:31.943 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:32.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:32.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:32.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:32.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:32.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:32.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:32.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:32.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:32.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:32.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:32.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:32.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:32.123 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:32.210 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:32.210 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:32.210 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:32.211 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.211 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.211 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.211 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.212 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:32.224 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RESTARTING to RUNNING.
12:14:32.224 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job c0988648dfcd43275159a42b4d64d13e from Checkpoint 61 @ 1783512870892 for c0988648dfcd43275159a42b4d64d13e located at file:/tmp/junit5149282460191757602/checkpoints/c0988648dfcd43275159a42b4d64d13e/chk-61.
12:14:32.225 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:14:32.225 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:14:32.226 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:14:32.226 [INFO - Thread-31] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:14:32.226 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state TERMINATED
12:14:32.226 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state TERMINATED
12:14:32.227 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:14:32.227 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:14:32.227 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:14:32.228 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
12:14:32.231 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:14:32.232 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
12:14:32.232 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:14:32.232 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
12:14:32.233 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
12:14:32.233 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:14:32.233 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:32.233 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:32.233 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:14:32.233 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:14:32.233 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:14:32.234 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:14:32.237 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@746f53a1
12:14:32.237 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:32.237 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:32.238 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:14:32.238 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:14:32.241 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1beeb708
12:14:32.241 [DEBUG - Thread-31] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state TERMINATED
12:14:32.242 [DEBUG - Thread-31] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:32.242 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:32.242 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:14:32.243 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:14:32.243 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:32.244 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:14:32.245 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:14:32.245 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
12:14:32.245 [INFO - Thread-31] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:14:32.245 [INFO - Thread-31] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:14:32.246 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:14:32.247 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:14:32.247 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
12:14:32.247 [DEBUG - Thread-31] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:32.247 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6118faae
12:14:32.247 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:32.248 [INFO - Thread-31] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:32.248 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:32.248 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
12:14:32.248 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
12:14:32.248 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3fa52e41
12:14:32.249 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:14:32.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:32.249 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:14:32.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:32.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:14:32.250 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:14:32.251 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@433da84c
12:14:32.253 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@433a4466
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:14:32.254 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:14:32.255 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:14:32.257 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46b8a6fe
12:14:32.260 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@567c9c38
12:14:32.263 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:32.264 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:32.264 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:32.264 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:32.264 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:32.265 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:32.265 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.266 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.266 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.266 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.266 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.267 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.267 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.268 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.268 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.268 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.268 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.269 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.270 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.271 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.271 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.272 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.273 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.273 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.274 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.277 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.277 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.277 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.277 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.278 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.278 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.278 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.278 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.278 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.279 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.279 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.279 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.280 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.280 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.281 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.281 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.281 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.281 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.282 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.282 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.289 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.289 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.290 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.291 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.296 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.296 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.296 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.300 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.301 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.303 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.304 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.304 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.304 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.304 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.305 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.305 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.305 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.306 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.306 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.306 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.306 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.306 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.307 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.307 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.307 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.308 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.308 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.308 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.308 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.308 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.309 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.309 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.310 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.311 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.311 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.311 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.311 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.312 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.312 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.313 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.313 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.313 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.313 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.313 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.313 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.314 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.314 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.314 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.314 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.314 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.315 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.315 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.316 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.317 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.317 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.317 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.318 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.318 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.318 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.318 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.319 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.319 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:32.319 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.319 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.319 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.319 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:32.320 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:32.320 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.320 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.320 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.320 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.320 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.320 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:32.320 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.321 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.321 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.321 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.322 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.323 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.323 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.323 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.324 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.325 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.325 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.325 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.327 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.327 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.328 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.328 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.328 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.328 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.328 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.329 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.330 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.330 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.330 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.330 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.331 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.331 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.340 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.340 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.341 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:32.341 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:32.341 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:32.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.341 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.341 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.341 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.341 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.342 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.342 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.342 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:32.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.342 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.341 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.342 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.342 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.350 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.350 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.350 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.350 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.350 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.350 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.351 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.351 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.350 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.351 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.351 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.351 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.351 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.356 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.356 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.356 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.356 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.356 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.356 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.357 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.357 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.363 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.363 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.363 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.363 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.364 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.366 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.366 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.368 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.368 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.369 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.369 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.369 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.371 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.371 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.372 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.372 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.372 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.372 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.372 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.372 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.372 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.372 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.372 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.372 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.372 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.372 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.373 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.373 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.373 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.373 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.373 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.373 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.374 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.375 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.375 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.375 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.375 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.375 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.375 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.375 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.380 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.380 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.380 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.380 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.382 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.382 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.382 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.382 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.382 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.382 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.383 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.383 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.387 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:32.387 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:32.387 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:32.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:32.388 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.388 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.388 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:32.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:32.389 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:32.389 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.389 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.390 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.391 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.391 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.391 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.392 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.392 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.392 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.392 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.392 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.392 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.392 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.409 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.409 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.409 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.411 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.411 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.411 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.411 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.412 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.412 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.412 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.412 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.412 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.412 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.412 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.412 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.413 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.413 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.413 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.414 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.414 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.414 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.414 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.414 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.415 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.415 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.415 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.416 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:32.263971 18472 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 18464
12:14:32.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:32.420410 18464 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.551s	user 0.000s	sys 0.002s
12:14:32.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:32.420993 18464 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.552s	user 0.000s	sys 0.002s
12:14:32.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:30.871133 18474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:32.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.426043 18464 server_base.cc:1061] running on GCE node
12:14:32.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:32.426050 18553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:32.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.429033 18464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:32.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.431180 18464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:32.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.432 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.432 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.432 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.432 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.432 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.432 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.432 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.432 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.432 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.432 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.432789 18464 hybrid_clock.cc:648] HybridClock initialized: now 1783512872432743 us; error 40 us; skew 500 ppm
12:14:32.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.433619 18464 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:32.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.439145 18464 webserver.cc:533] Webserver started at http://127.17.135.194:44587/ using document root <none> and password file <none>
12:14:32.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.440253 18464 fs_manager.cc:362] Metadata directory not provided
12:14:32.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.440714 18464 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:32.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.441 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.441 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.441 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.441355 18464 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:32.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.441 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.447420 18464 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data/instance:
12:14:32.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:32.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:32 on dist-test-slave-vcgh"
12:14:32.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.448973 18464 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal/instance:
12:14:32.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:32.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:32 on dist-test-slave-vcgh"
12:14:32.451 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.451 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.451 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.452 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.452 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.452 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.452 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.452 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.453 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.461354 18464 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.010s	sys 0.001s
12:14:32.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.468729 18558 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:32.469 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.469 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.469 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.469 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.469 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.470 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.470 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.470 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.470 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.470 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.470 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.471 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.471 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.471 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.471 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.471029 18464 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.001s
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.471415 18464 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:32 on dist-test-slave-vcgh"
12:14:32.470 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.471947 18464 fs_report.cc:389] FS layout report
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data/data
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:32.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:32.490 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.491 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.491 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.491 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.491 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.492 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.492 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.492 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.492 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.492 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.492 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.492 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.492 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.492 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.530164 18464 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:32.530 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.531 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.531 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.532 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.532 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.531960 18464 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:32.532 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.532 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.532579 18464 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:32.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.535194 18464 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.539214 18464 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.539409 18464 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.539613 18464 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.539740 18464 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:32.551 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.552 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.552 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.552 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.552 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.552 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.553 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.553 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.553 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.553 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.560 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.561 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.561 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.561 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.561 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.561 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.561 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.561 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.561 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.562 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.562 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.562 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.562 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.590 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.591 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.591 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.591 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.591 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.591 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.591 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.600 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.601 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.601 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.601 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.601 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.601 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.601 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.601 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.602 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.602 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.609 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.609 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.610 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.610 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.610 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.610 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.610 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.610 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.610 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.611 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.649 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.650 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.650 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.650 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.650 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.650 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.651 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.684088 18464 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.194:38601
12:14:32.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.684221 18670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.194:38601 every 8 connection(s)
12:14:32.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.686596 18464 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/data/info.pb
12:14:32.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.688536 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 18464
12:14:32.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.689172 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-1/wal/instance
12:14:32.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.691 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.691 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.691 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.692 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.692 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.692 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.692 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.692 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.692 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.693 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.693 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.693 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.693 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.693 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.693 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.693 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.694 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.694 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.694 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.694 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.709 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.709 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.710 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.710 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.710 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.710 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.710 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.710 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.710 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.711 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.711 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.711 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.711 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.716004 17951 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/logs
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data/info.pb
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.195:0
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.195
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.195
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:32.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:32.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.729846 18672 heartbeater.cc:344] Connected to a master server at 127.17.135.253:43339
12:14:32.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.730424 18672 heartbeater.cc:461] Registering TS with master...
12:14:32.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.731926 18672 heartbeater.cc:507] Master 127.17.135.253:43339 requested a full tablet report, sending...
12:14:32.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.732940 18671 heartbeater.cc:344] Connected to a master server at 127.17.135.252:38447
12:14:32.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.733286 18671 heartbeater.cc:461] Registering TS with master...
12:14:32.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.734093 18671 heartbeater.cc:507] Master 127.17.135.252:38447 requested a full tablet report, sending...
12:14:32.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.736249 18138 ts_manager.cc:194] Registered new tserver with Master: 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:32.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.737934 18220 ts_manager.cc:194] Registered new tserver with Master: 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:32.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.739527 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.135.194:53713
12:14:32.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.747395 18675 heartbeater.cc:344] Connected to a master server at 127.17.135.254:37603
12:14:32.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.747733 18675 heartbeater.cc:461] Registering TS with master...
12:14:32.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.748350 18675 heartbeater.cc:507] Master 127.17.135.254:37603 requested a full tablet report, sending...
12:14:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:32.751739 17997 ts_manager.cc:194] Registered new tserver with Master: 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:32.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.792 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.792 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.793 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.793 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.793 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:32.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:32.841 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:32.841 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:32.842 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:32.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:32.860 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:32.860 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:32.861 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:32.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:32.861 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:32.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:32.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:32.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:32.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:32.861 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.861 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:32.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.862 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.862 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:32.862 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:32.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:32.862 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:32.970 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:32.971 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:32.971 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:32.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:32.971 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:32.972 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.972 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.972 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:32.972 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.042379 18681 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:33.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.042906 18681 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:33.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.043434 18681 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:33.051 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.051 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.051 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.052 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.052 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.052 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.052 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.052 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.052 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.052 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.052 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.052 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.052 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.077147 18681 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:33.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.078033 18681 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.135.195
12:14:33.079 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:33.080 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:33.080 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:33.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.080 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.080 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.080 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.080 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.081 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.081 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:33.110 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.110 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.110 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.111 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.111 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.111 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:33.116532 18681 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.17.135.212:46557
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.17.135.195:0
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data/info.pb
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.17.135.195
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.17.135.254:37603,127.17.135.253:43339,127.17.135.252:38447
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:33.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.17.135.195
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/logs
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:33.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:33.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:33.118340 18681 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:33.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:33.119922 18681 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:33.131 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.131 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.132 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.132 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.132 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.132 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.132 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.132 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.134545 18688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:33.189 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.189 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.190 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.190 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.190 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.190 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.191 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.191 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.190 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.191 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.191 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.259 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:33.260 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:33.260 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:33.261 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.262 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.262 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:33.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:33.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:33.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:33.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:33.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:33.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:33.443 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:33.443 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:33.443 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:33.443 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:33.443 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:33.443 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:33.443 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:33.511 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.511 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.512 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.514 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.514 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.591 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:33.592 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:33.592 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:33.592 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.592 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.593 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:33.593 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.593 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.593 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:33.593 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.594 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:33.594 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:33.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:33.743185 18671 heartbeater.cc:499] Master 127.17.135.252:38447 was elected leader, sending a full tablet report...
12:14:33.747 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:33.747 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:33.747 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:33.748 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:33.748 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:33.748 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:33.749 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:33.749 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:33.749 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:33.749 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:33.749 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:33.749 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:33.749 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:33.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:33.870 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:33.871 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:33.871 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:33.871 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.871 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.871 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:33.871 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.871 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:33.872 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.872 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.872 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:33.872 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:33.982 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:33.982 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:33.982 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:33.983 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:33.983 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:33.983 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:33.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:33.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:33.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:33.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:33.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:33.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:33.985 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:34.072 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:34.073 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:34.073 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:34.073 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:34.074 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:34.074 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:34.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:34.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:34.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:34.076 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:34.076 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:34.076 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:34.076 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:34.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.227 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:34.227 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:34.227 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:34.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.228 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.229 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.229 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.229 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.229 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:34.271 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:34.272 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:34.272 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:34.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.273 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.273 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:34.273 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.273 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.273 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:34.273 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:34.274 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:34.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:34.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:34.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:34.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.350 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.351 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.351 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.351 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.351 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:34.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.534947 18687 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 18681
12:14:34.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.562000 18681 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.428s	user 0.498s	sys 0.904s
12:14:34.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.562301 18681 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.428s	user 0.498s	sys 0.904s
12:14:34.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:33.135613 18689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:34.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.564419 18691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:34.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.569218 18690 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1434 milliseconds
12:14:34.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.569249 18681 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:34.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.570660 18681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:34.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.572929 18681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:34.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.574258 18681 hybrid_clock.cc:648] HybridClock initialized: now 1783512874574219 us; error 52 us; skew 500 ppm
12:14:34.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.575186 18681 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:34.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.580996 18681 webserver.cc:533] Webserver started at http://127.17.135.195:39165/ using document root <none> and password file <none>
12:14:34.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.581862 18681 fs_manager.cc:362] Metadata directory not provided
12:14:34.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.582046 18681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:34.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.582515 18681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:34.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.586866 18681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data/instance:
12:14:34.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a23113f6788a4602994404c467dee91e"
12:14:34.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:34 on dist-test-slave-vcgh"
12:14:34.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.588109 18681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal/instance:
12:14:34.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a23113f6788a4602994404c467dee91e"
12:14:34.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:34 on dist-test-slave-vcgh"
12:14:34.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.595531 18681 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
12:14:34.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.601284 18699 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:34.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.602342 18681 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.602670 18681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a23113f6788a4602994404c467dee91e"
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:34 on dist-test-slave-vcgh"
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.602999 18681 fs_report.cc:389] FS layout report
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data/data
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:34.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:34.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.645 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:34.645 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:34.646 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:34.646 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:34.646 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:34.646 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:34.646 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:34.646 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:34.646 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:34.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:34.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:34.647 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:34.647 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:34.650 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:34.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:34.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:34.651 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.651 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.651 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.651 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.651 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.651 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:34.651 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:34.652 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:34.652 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:34.652 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.652 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.652 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.652 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.652 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.652 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.652 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:34.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.654990 18681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:34.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.656810 18681 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:34.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.657256 18681 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:34.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.659734 18681 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:14:34.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.663757 18681 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:14:34.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.663965 18681 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:14:34.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.664237 18681 ts_tablet_manager.cc:616] Registered 0 tablets
12:14:34.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.664395 18681 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:14:34.752 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:34.753 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:34.753 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:34.754 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.754 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.754 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.754 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.754 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.755 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:34.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.808333 18681 rpc_server.cc:307] RPC server started. Bound to: 127.17.135.195:35771
12:14:34.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.808434 18812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.135.195:35771 every 8 connection(s)
12:14:34.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.810879 18681 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/data/info.pb
12:14:34.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.818869 17951 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 18681
12:14:34.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.819326 17951 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster16168702951446245712/ts-2/wal/instance
12:14:34.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.868115 18813 heartbeater.cc:344] Connected to a master server at 127.17.135.252:38447
12:14:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.868595 18813 heartbeater.cc:461] Registering TS with master...
12:14:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.869935 18813 heartbeater.cc:507] Master 127.17.135.252:38447 requested a full tablet report, sending...
12:14:34.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.874965 18220 ts_manager.cc:194] Registered new tserver with Master: a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:34.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.876650 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.17.135.195:55901
12:14:34.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.879374 18814 heartbeater.cc:344] Connected to a master server at 127.17.135.253:43339
12:14:34.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.879709 18814 heartbeater.cc:461] Registering TS with master...
12:14:34.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.880775 18814 heartbeater.cc:507] Master 127.17.135.253:43339 requested a full tablet report, sending...
12:14:34.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.883338 18138 ts_manager.cc:194] Registered new tserver with Master: a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:34.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.886686 18815 heartbeater.cc:344] Connected to a master server at 127.17.135.254:37603
12:14:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.887014 18815 heartbeater.cc:461] Registering TS with master...
12:14:34.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.887627 18815 heartbeater.cc:507] Master 127.17.135.254:37603 requested a full tablet report, sending...
12:14:34.889 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:34.889 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:34.890 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:34.890 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.890 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.890 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:34.890 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.890 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:34.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:34.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.890009 17997 ts_manager.cc:194] Registered new tserver with Master: a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:34.890 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:34.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.901144 17951 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:14:34.911 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:14:34.912 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:14:34.913 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.17.135.254"
      port: 37603
    }
    bound_http_address {
      host: "127.17.135.254"
      port: 44207
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.17.135.253"
      port: 43339
    }
    bound_http_address {
      host: "127.17.135.253"
      port: 34261
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.17.135.252"
      port: 38447
    }
    bound_http_address {
      host: "127.17.135.252"
      port: 32863
    }
  }
}

12:14:34.913 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:14:34.913 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.17.135.193"
      port: 45465
    }
    bound_http_address {
      host: "127.17.135.193"
      port: 42075
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.17.135.194"
      port: 38601
    }
    bound_http_address {
      host: "127.17.135.194"
      port: 44587
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.17.135.195"
      port: 35771
    }
    bound_http_address {
      host: "127.17.135.195"
      port: 39165
    }
  }
}

12:14:34.914 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:14:34.915 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:34.916 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:34.917 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:34.917 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.16.194.126:33897(127.16.194.126:33897)] Successfully connected to peer
12:14:34.920 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:34.921 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.16.194.125:40961(127.16.194.125:40961)] Successfully connected to peer
12:14:34.923 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.126
12:14:34.925 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.125
12:14:34.928 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.16.194.124:36205(127.16.194.124:36205)] Successfully connected to peer
12:14:34.935 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.124
12:14:34.935 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:34.940 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x15e637eb, L:/127.0.0.1:44120 - R:/127.16.194.125:40961] using SASL/PLAIN
12:14:34.943 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:34.944 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:34.947 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x22ecf1e0, L:/127.0.0.1:55086 - R:/127.16.194.126:33897] using SASL/PLAIN
12:14:34.947 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf0b66453, L:/127.0.0.1:43802 - R:/127.16.194.124:36205] using SASL/PLAIN
12:14:34.951 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:34.951 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=35), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [27ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: OK, [34ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: OK, deferred=null) after lookup
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:34.952994 17423 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43802:
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\0012\000\000\000\004\001\226\000\000\000"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
12:14:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:34.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:34.957043 17423 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:14:35.004 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:35.061 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.061 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.061 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.061 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.061 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.061 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.061 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.061 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.061 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.062 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.062 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.062 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.062 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.070 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:35.070 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:35.071 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:35.071 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.071 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.071 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.071 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.071 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.071 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.071 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.071 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.072 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:35.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.078568 17733 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7abeeb47504b5988bb5e1c49541acf (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.080462 17733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7abeeb47504b5988bb5e1c49541acf. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.083328 17873 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7abeeb47504b5988bb5e1c49541acf (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.086339 17873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7abeeb47504b5988bb5e1c49541acf. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.085796 17590 tablet_service.cc:1511] Processing CreateTablet for tablet 18e98bc7615e4665a6e500c1cab31dda (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:35.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.087844 17732 tablet_service.cc:1511] Processing CreateTablet for tablet 18e98bc7615e4665a6e500c1cab31dda (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:35.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.088327 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e98bc7615e4665a6e500c1cab31dda. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.089260 17732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e98bc7615e4665a6e500c1cab31dda. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.090250 17589 tablet_service.cc:1511] Processing CreateTablet for tablet a0e07e3365584bb38520a776f55ad0d2 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.090965 17874 tablet_service.cc:1511] Processing CreateTablet for tablet 386b64c8ec0c469ebd53d12eadb01231 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.092000 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 74735e91682e470180aaef67e499fada (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.093603 17592 tablet_service.cc:1511] Processing CreateTablet for tablet 386b64c8ec0c469ebd53d12eadb01231 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.093828 17875 tablet_service.cc:1511] Processing CreateTablet for tablet 0b11d3194e5543248721bee067c8f278 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:35.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.093653 17591 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7abeeb47504b5988bb5e1c49541acf (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.094835 17593 tablet_service.cc:1511] Processing CreateTablet for tablet 0b11d3194e5543248721bee067c8f278 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:35.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.096318 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386b64c8ec0c469ebd53d12eadb01231. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.097070 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7abeeb47504b5988bb5e1c49541acf. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.097200 17872 tablet_service.cc:1511] Processing CreateTablet for tablet 18e98bc7615e4665a6e500c1cab31dda (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.098730 17589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e07e3365584bb38520a776f55ad0d2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.092518 17874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386b64c8ec0c469ebd53d12eadb01231. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.099728 17872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e98bc7615e4665a6e500c1cab31dda. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.099915 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74735e91682e470180aaef67e499fada. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.101251 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b11d3194e5543248721bee067c8f278. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.101606 17875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b11d3194e5543248721bee067c8f278. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.084504 17734 tablet_service.cc:1511] Processing CreateTablet for tablet 386b64c8ec0c469ebd53d12eadb01231 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.105182 17734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 386b64c8ec0c469ebd53d12eadb01231. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.106771 17871 tablet_service.cc:1511] Processing CreateTablet for tablet a0e07e3365584bb38520a776f55ad0d2 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.108462 17731 tablet_service.cc:1511] Processing CreateTablet for tablet a0e07e3365584bb38520a776f55ad0d2 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:35.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.109719 17731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e07e3365584bb38520a776f55ad0d2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.109323 17730 tablet_service.cc:1511] Processing CreateTablet for tablet 74735e91682e470180aaef67e499fada (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.110576 17730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74735e91682e470180aaef67e499fada. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.077505 17735 tablet_service.cc:1511] Processing CreateTablet for tablet 0b11d3194e5543248721bee067c8f278 (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:35.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.112017 17735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b11d3194e5543248721bee067c8f278. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.133387 17871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e07e3365584bb38520a776f55ad0d2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.146659 17870 tablet_service.cc:1511] Processing CreateTablet for tablet 74735e91682e470180aaef67e499fada (DEFAULT_TABLE table=replication_test_table [id=2aa3e12bd98f4cbd85dcb859657dac53]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:35.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.147967 17870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74735e91682e470180aaef67e499fada. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:35.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.175661 18848 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.184231 18848 tablet_bootstrap.cc:654] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.186689 18848 log.cc:826] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: Log is configured to *not* fsync() on all Append() calls
12:14:35.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.199445 18848 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.203118 18848 ts_tablet_manager.cc:1403] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
12:14:35.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.215224 18852 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.220494 18850 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.240705 18848 raft_consensus.cc:359] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.241778 18848 raft_consensus.cc:385] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.242091 18848 raft_consensus.cc:740] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.243157 18848 consensus_queue.cc:260] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.244650 18850 tablet_bootstrap.cc:654] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.247260 18850 log.cc:826] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Log is configured to *not* fsync() on all Append() calls
12:14:35.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.255373 18852 tablet_bootstrap.cc:654] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.257855 18852 log.cc:826] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Log is configured to *not* fsync() on all Append() calls
12:14:35.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.259049 18848 ts_tablet_manager.cc:1434] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.056s	user 0.029s	sys 0.014s
12:14:35.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.259608 18850 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.260031 18848 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.260560 18850 ts_tablet_manager.cc:1403] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.008s
12:14:35.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.266664 18848 tablet_bootstrap.cc:654] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.282907 18852 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.283622 18852 ts_tablet_manager.cc:1403] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.005s
12:14:35.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.287557 18848 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.287987 18848 ts_tablet_manager.cc:1403] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
12:14:35.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.290942 18848 raft_consensus.cc:359] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.291800 18848 raft_consensus.cc:385] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.292074 18848 raft_consensus.cc:740] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.292969 18848 consensus_queue.cc:260] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.295879 18848 ts_tablet_manager.cc:1434] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
12:14:35.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.296856 18848 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.303421 18848 tablet_bootstrap.cc:654] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.313194 18852 raft_consensus.cc:359] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.314360 18852 raft_consensus.cc:385] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.314780 18852 raft_consensus.cc:740] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.316031 18852 consensus_queue.cc:260] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.319136 18850 raft_consensus.cc:359] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.320075 18850 raft_consensus.cc:385] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.320379 18850 raft_consensus.cc:740] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.320644 18848 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.321099 18848 ts_tablet_manager.cc:1403] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
12:14:35.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.321503 18850 consensus_queue.cc:260] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.324326 18848 raft_consensus.cc:359] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.325085 18848 raft_consensus.cc:385] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.325366 18848 raft_consensus.cc:740] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.326349 18848 consensus_queue.cc:260] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.329272 18848 ts_tablet_manager.cc:1434] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
12:14:35.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.330188 18848 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.338270 18848 tablet_bootstrap.cc:654] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.363606 18850 ts_tablet_manager.cc:1434] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.103s	user 0.036s	sys 0.027s
12:14:35.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.364670 18850 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.370801 17803 tablet.cc:2406] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:35.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.373095 18850 tablet_bootstrap.cc:654] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:35.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:35.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:35.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:35.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:35.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:35.382 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:35.382 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:35.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:35.383 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:35.383 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:35.383 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:35.383 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:35.389 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:35.390 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:35.390 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:35.390 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.390 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.390 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.391 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.391 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.391 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.391 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.391 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.391 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.391 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:35.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.397135 18852 ts_tablet_manager.cc:1434] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.113s	user 0.050s	sys 0.033s
12:14:35.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.398195 18850 tablet_bootstrap.cc:492] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.399448 18852 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.399966 18850 ts_tablet_manager.cc:1403] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.011s
12:14:35.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.405478 18852 tablet_bootstrap.cc:654] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.408303 18850 raft_consensus.cc:359] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.408988 18850 raft_consensus.cc:385] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.409265 18850 raft_consensus.cc:740] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.409935 18850 consensus_queue.cc:260] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.410812 18848 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.411440 18848 ts_tablet_manager.cc:1403] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.081s	user 0.036s	sys 0.020s
12:14:35.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.411831 18850 ts_tablet_manager.cc:1434] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.001s
12:14:35.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.412747 18850 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.414546 18848 raft_consensus.cc:359] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.415442 18848 raft_consensus.cc:385] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.415912 18848 raft_consensus.cc:740] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.416814 18848 consensus_queue.cc:260] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.419221 18848 ts_tablet_manager.cc:1434] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
12:14:35.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.420208 18848 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.429876 18848 tablet_bootstrap.cc:654] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.433246 18850 tablet_bootstrap.cc:654] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.441740 18848 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.442282 18848 ts_tablet_manager.cc:1403] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
12:14:35.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.445248 18848 raft_consensus.cc:359] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.446079 18848 raft_consensus.cc:385] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.446482 18848 raft_consensus.cc:740] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.447307 18848 consensus_queue.cc:260] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.451637 18848 ts_tablet_manager.cc:1434] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
12:14:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.452605 18848 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee: Bootstrap starting.
12:14:35.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.458997 18848 tablet_bootstrap.cc:654] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee: Neither blocks nor log segments found. Creating new log.
12:14:35.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.477936 17663 tablet.cc:2406] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:35.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.487115 18848 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee: No bootstrap required, opened a new log
12:14:35.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.487591 18848 ts_tablet_manager.cc:1403] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.016s
12:14:35.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.491082 18848 raft_consensus.cc:359] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.491722 18848 raft_consensus.cc:385] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.491997 18848 raft_consensus.cc:740] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Initialized, Role: FOLLOWER
12:14:35.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.492646 18848 consensus_queue.cc:260] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.498714 18848 ts_tablet_manager.cc:1434] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
12:14:35.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.502939 18853 raft_consensus.cc:493] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.503587 18853 raft_consensus.cc:515] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.509176 17948 tablet.cc:2406] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:35.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.511312 18853 leader_election.cc:290] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.493722 18859 raft_consensus.cc:493] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.514954 18859 raft_consensus.cc:515] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.529237 18859 leader_election.cc:290] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.530840 18859 raft_consensus.cc:493] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.531245 18859 raft_consensus.cc:515] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.539764 18859 leader_election.cc:290] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.546717 18850 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.547329 18850 ts_tablet_manager.cc:1403] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.135s	user 0.021s	sys 0.025s
12:14:35.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.550649 18850 raft_consensus.cc:359] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.552561 18850 raft_consensus.cc:385] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.554039 18852 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.553948 18850 raft_consensus.cc:740] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.554481 18852 ts_tablet_manager.cc:1403] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.155s	user 0.036s	sys 0.045s
12:14:35.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.554912 18850 consensus_queue.cc:260] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.557173 18852 raft_consensus.cc:359] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.557837 18852 raft_consensus.cc:385] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.558094 18852 raft_consensus.cc:740] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.558751 18852 consensus_queue.cc:260] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.561757 17613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:35.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.562376 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:35.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.562569 17613 raft_consensus.cc:2468] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 0.
12:14:35.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.563007 17612 raft_consensus.cc:2468] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 0.
12:14:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.564432 17690 leader_election.cc:304] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.565470 17690 leader_election.cc:304] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.567437 18866 raft_consensus.cc:2804] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:35.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.567826 18866 raft_consensus.cc:493] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:35.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.568122 18866 raft_consensus.cc:3060] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:35.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.571655 18859 raft_consensus.cc:2804] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:35.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.572886 18859 raft_consensus.cc:493] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:35.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.573352 18859 raft_consensus.cc:3060] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:35.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.574720 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.582096 18853 raft_consensus.cc:493] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.582511 18853 raft_consensus.cc:515] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.584352 18853 leader_election.cc:290] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.585836 18853 raft_consensus.cc:493] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.586210 18853 raft_consensus.cc:515] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.587952 18850 ts_tablet_manager.cc:1434] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
12:14:35.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.588757 18853 leader_election.cc:290] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.585929 18866 raft_consensus.cc:515] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.596889 18858 raft_consensus.cc:493] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.596915 17754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.597472 18858 raft_consensus.cc:515] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.598186 18866 leader_election.cc:290] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Requested vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.599014 18850 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.600502 17754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e07e3365584bb38520a776f55ad0d2" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.601132 17754 raft_consensus.cc:2468] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b65f7d707d2a4b17b865e73c787428ee in term 0.
12:14:35.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.603204 17549 leader_election.cc:343] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.604360 17549 leader_election.cc:304] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.605557 18850 tablet_bootstrap.cc:654] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.616432 18858 leader_election.cc:290] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:35.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.619 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.619 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.619 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.620 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.620 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.620 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.620 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.620 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.620 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.621 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.621 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.624167 18853 raft_consensus.cc:493] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.628998 18853 raft_consensus.cc:515] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.631311 18853 leader_election.cc:290] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.631902 17895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.632764 18852 ts_tablet_manager.cc:1434] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.002s
12:14:35.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.632926 17895 raft_consensus.cc:2468] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 0.
12:14:35.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.634148 18853 raft_consensus.cc:2804] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:35.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.634505 18853 raft_consensus.cc:493] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:35.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.634871 18853 raft_consensus.cc:3060] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:35.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.637189 17895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.642132 18853 raft_consensus.cc:515] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.594626 18859 raft_consensus.cc:515] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.644405 17755 raft_consensus.cc:2393] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b65f7d707d2a4b17b865e73c787428ee in current term 1: Already voted for candidate 5f32f8c83f4c4a3e9837d363869a92cb in this term.
12:14:35.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.645452 17754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7abeeb47504b5988bb5e1c49541acf" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.650 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:35.650 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:35.650 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:35.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:35.651 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.651 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.651 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:35.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:35.651 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:35.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.647828 17549 leader_election.cc:343] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.653788 18859 leader_election.cc:290] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Requested vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.657398 18853 leader_election.cc:290] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 election: Requested vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.657433 17690 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.194.65:46145, user_credentials={real_user=slave}} blocked reactor thread for 92022us
12:14:35.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.659890 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:35.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.660385 17612 raft_consensus.cc:3060] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:35.661 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.661 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.661 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.662 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.662 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.662 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.662135 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e07e3365584bb38520a776f55ad0d2" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:35.662 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.666520 17612 raft_consensus.cc:2468] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 1.
12:14:35.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.666682 17755 raft_consensus.cc:3060] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:35.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.668430 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:35.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.668937 17612 raft_consensus.cc:3060] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:35.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.673120 17690 leader_election.cc:304] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.675947 17612 raft_consensus.cc:2468] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 1.
12:14:35.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.676771 18850 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.677271 18850 ts_tablet_manager.cc:1403] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.016s
12:14:35.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.674054 18872 raft_consensus.cc:2804] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election won for term 1
12:14:35.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.679661 18872 raft_consensus.cc:697] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 LEADER]: Becoming Leader. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Running, Role: LEADER
12:14:35.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.680037 17894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:35.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.680845 18852 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.681083 17894 raft_consensus.cc:3060] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:35.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.681365 17691 leader_election.cc:343] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.681711 18872 consensus_queue.cc:237] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.682667 17690 leader_election.cc:304] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.683490 17755 raft_consensus.cc:2468] T a0e07e3365584bb38520a776f55ad0d2 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b65f7d707d2a4b17b865e73c787428ee in term 1.
12:14:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.684114 18859 raft_consensus.cc:2804] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election won for term 1
12:14:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.684532 18859 raft_consensus.cc:697] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 LEADER]: Becoming Leader. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Running, Role: LEADER
12:14:35.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.685531 18859 consensus_queue.cc:237] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.693039 18850 raft_consensus.cc:359] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.693728 18850 raft_consensus.cc:385] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.696103 18850 raft_consensus.cc:740] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.697624 18850 consensus_queue.cc:260] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.701669 17895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:35.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.702693 18850 ts_tablet_manager.cc:1434] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
12:14:35.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.704880 18850 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.710434 17691 leader_election.cc:343] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.711244 18853 raft_consensus.cc:493] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.711423 17895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.711694 18853 raft_consensus.cc:515] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.711961 17893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.713419 17893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e07e3365584bb38520a776f55ad0d2" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.713634 18853 leader_election.cc:290] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965), 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:35.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.714646 17893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7abeeb47504b5988bb5e1c49541acf" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.715137 17893 raft_consensus.cc:2468] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b65f7d707d2a4b17b865e73c787428ee in term 0.
12:14:35.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.716249 17893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e07e3365584bb38520a776f55ad0d2" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:35.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.716570 17754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.717707 17549 leader_election.cc:343] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.718369 18850 tablet_bootstrap.cc:654] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.720191 17893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:35.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.721390 17549 leader_election.cc:343] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.721761 17549 leader_election.cc:304] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee; no voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88
12:14:35.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.722046 18852 tablet_bootstrap.cc:654] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.722440 18853 raft_consensus.cc:2749] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:35.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.723268 17549 leader_election.cc:343] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.723685 17549 leader_election.cc:304] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee; no voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88
12:14:35.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.724509 18853 raft_consensus.cc:2749] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:35.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.725100 17549 leader_election.cc:343] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.725628 17894 raft_consensus.cc:2468] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 1.
12:14:35.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.726681 17549 leader_election.cc:304] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee; no voters: 
12:14:35.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.727337 18853 raft_consensus.cc:2804] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election won for term 1
12:14:35.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.727813 18853 raft_consensus.cc:697] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [term 1 LEADER]: Becoming Leader. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Running, Role: LEADER
12:14:35.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.728754 18853 consensus_queue.cc:237] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.729023 17549 leader_election.cc:304] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 5f32f8c83f4c4a3e9837d363869a92cb
12:14:35.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.733129 18873 raft_consensus.cc:2804] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:35.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.733247 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:35.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.733521 18873 raft_consensus.cc:493] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:35.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.733824 18873 raft_consensus.cc:3060] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:35.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.738176 17549 leader_election.cc:343] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.739732 17549 leader_election.cc:343] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965): Illegal state: must be running to vote when last-logged opid is not known
12:14:35.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.740065 17549 leader_election.cc:304] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee; no voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88
12:14:35.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.743649 18873 raft_consensus.cc:515] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.746740 18873 leader_election.cc:290] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 election: Requested vote from peers 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941), e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965)
12:14:35.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.746044 17424 catalog_manager.cc:5697] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66). New cstate: current_term: 1 leader_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: UNKNOWN } } }
12:14:35.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.747531 18852 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.748025 18852 ts_tablet_manager.cc:1403] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.002s
12:14:35.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.748598 18873 raft_consensus.cc:2749] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:35.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.748696 17424 catalog_manager.cc:5697] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66). New cstate: current_term: 1 leader_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: UNKNOWN } } }
12:14:35.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.750636 18852 raft_consensus.cc:359] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.751308 18852 raft_consensus.cc:385] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.751608 18852 raft_consensus.cc:740] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.755142 18850 tablet_bootstrap.cc:492] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.755558 18850 ts_tablet_manager.cc:1403] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.002s
12:14:35.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.761909 18850 raft_consensus.cc:359] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.762578 18850 raft_consensus.cc:385] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.762845 18850 raft_consensus.cc:740] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.763687 18850 consensus_queue.cc:260] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.765875 18850 ts_tablet_manager.cc:1434] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
12:14:35.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.766776 18850 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb: Bootstrap starting.
12:14:35.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.766460 18852 consensus_queue.cc:260] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:35.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.773304 18850 tablet_bootstrap.cc:654] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb: Neither blocks nor log segments found. Creating new log.
12:14:35.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.773669 18852 ts_tablet_manager.cc:1434] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
12:14:35.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.774537 18852 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.786063 18850 tablet_bootstrap.cc:492] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb: No bootstrap required, opened a new log
12:14:35.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.786525 18850 ts_tablet_manager.cc:1403] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
12:14:35.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.789162 18850 raft_consensus.cc:359] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:35.789702 17549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.194.67:34965, user_credentials={real_user=slave}} blocked reactor thread for 49969.3us
12:14:35.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.790081 18850 raft_consensus.cc:385] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.790340 18850 raft_consensus.cc:740] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Initialized, Role: FOLLOWER
12:14:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.791468 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7abeeb47504b5988bb5e1c49541acf" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.791204 18850 consensus_queue.cc:260] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.792196 17755 raft_consensus.cc:3060] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:35.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.794772 17423 catalog_manager.cc:5697] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee reported cstate change: term changed from 0 to 1, leader changed from <none> to b65f7d707d2a4b17b865e73c787428ee (127.16.194.65). New cstate: current_term: 1 leader_uuid: "b65f7d707d2a4b17b865e73c787428ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: UNKNOWN } } }
12:14:35.820 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.820 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.820 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.821 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.821 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.816249 17894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7abeeb47504b5988bb5e1c49541acf" candidate_uuid: "b65f7d707d2a4b17b865e73c787428ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:35.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.816807 17894 raft_consensus.cc:3060] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:35.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.817670 18852 tablet_bootstrap.cc:654] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.824450 17894 raft_consensus.cc:2468] T 4f7abeeb47504b5988bb5e1c49541acf P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b65f7d707d2a4b17b865e73c787428ee in term 1.
12:14:35.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.828951 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "386b64c8ec0c469ebd53d12eadb01231" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:35.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.829792 17612 raft_consensus.cc:2393] T 386b64c8ec0c469ebd53d12eadb01231 P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in current term 1: Already voted for candidate 5f32f8c83f4c4a3e9837d363869a92cb in this term.
12:14:35.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.831087 17549 leader_election.cc:304] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 
12:14:35.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:35.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.837213 17830 leader_election.cc:304] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee
12:14:35.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.838153 18858 raft_consensus.cc:2749] T 386b64c8ec0c469ebd53d12eadb01231 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:35.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.839653 18882 raft_consensus.cc:2804] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election won for term 1
12:14:35.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.840837 17755 raft_consensus.cc:2468] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b65f7d707d2a4b17b865e73c787428ee in term 1.
12:14:35.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.842479 18882 raft_consensus.cc:697] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [term 1 LEADER]: Becoming Leader. State: Replica: b65f7d707d2a4b17b865e73c787428ee, State: Running, Role: LEADER
12:14:35.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.843730 18882 consensus_queue.cc:237] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.858476 18850 ts_tablet_manager.cc:1434] T 4f7abeeb47504b5988bb5e1c49541acf P 5f32f8c83f4c4a3e9837d363869a92cb: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
12:14:35.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.862 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.862 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.863 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.883064 18813 heartbeater.cc:499] Master 127.17.135.252:38447 was elected leader, sending a full tablet report...
12:14:35.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.896835 18852 tablet_bootstrap.cc:492] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.897305 18852 ts_tablet_manager.cc:1403] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.002s
12:14:35.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.908480 18852 raft_consensus.cc:359] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.909 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:35.910 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:35.910 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:35.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:35.910 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:35.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:35.911 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:35.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.909454 17424 catalog_manager.cc:5697] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee reported cstate change: term changed from 0 to 1, leader changed from <none> to b65f7d707d2a4b17b865e73c787428ee (127.16.194.65). New cstate: current_term: 1 leader_uuid: "b65f7d707d2a4b17b865e73c787428ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: UNKNOWN } } }
12:14:35.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.909241 18852 raft_consensus.cc:385] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.911706 18852 raft_consensus.cc:740] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.912434 18852 consensus_queue.cc:260] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.914448 18852 ts_tablet_manager.cc:1434] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
12:14:35.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.918418 18852 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.926110 18852 tablet_bootstrap.cc:654] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.932 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:35.932 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:35.933 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:35.933 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:35.933 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:35.933 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:35.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:35.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:35.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:35.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:35.934 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:35.934 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:35.934 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:35.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.938475 18852 tablet_bootstrap.cc:492] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.938858 18852 ts_tablet_manager.cc:1403] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
12:14:35.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.940910 18852 raft_consensus.cc:359] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.941365 18852 raft_consensus.cc:385] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.941540 18852 raft_consensus.cc:740] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.942025 18852 consensus_queue.cc:260] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.943841 18852 ts_tablet_manager.cc:1434] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
12:14:35.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.945303 18852 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88: Bootstrap starting.
12:14:35.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.951311 18852 tablet_bootstrap.cc:654] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88: Neither blocks nor log segments found. Creating new log.
12:14:35.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.956537 18852 tablet_bootstrap.cc:492] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88: No bootstrap required, opened a new log
12:14:35.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.956853 18852 ts_tablet_manager.cc:1403] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
12:14:35.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.958611 18852 raft_consensus.cc:359] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.959059 18852 raft_consensus.cc:385] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:35.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.959259 18852 raft_consensus.cc:740] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Initialized, Role: FOLLOWER
12:14:35.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.959753 18852 consensus_queue.cc:260] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:35.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.961534 18852 ts_tablet_manager.cc:1434] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.002s
12:14:35.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.997484 18872 raft_consensus.cc:493] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:35.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.997956 18872 raft_consensus.cc:515] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:36.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:35.999948 18872 leader_election.cc:290] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965), b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145)
12:14:36.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.000823 17894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" is_pre_election: true
12:14:36.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.001221 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:36.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.001390 17894 raft_consensus.cc:2468] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 0.
12:14:36.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.001739 17612 raft_consensus.cc:2468] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 0.
12:14:36.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.002627 17691 leader_election.cc:304] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 
12:14:36.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.003278 18872 raft_consensus.cc:2804] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:36.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.003580 18872 raft_consensus.cc:493] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:36.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.003866 18872 raft_consensus.cc:3060] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:36.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.010321 18872 raft_consensus.cc:515] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:36.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.013615 17894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88"
12:14:36.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.014082 17894 raft_consensus.cc:3060] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:36.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.014384 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b11d3194e5543248721bee067c8f278" candidate_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:36.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.014881 17612 raft_consensus.cc:3060] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:36.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.018559 17894 raft_consensus.cc:2468] T 0b11d3194e5543248721bee067c8f278 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 1.
12:14:36.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.019433 17691 leader_election.cc:304] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 
12:14:36.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.020061 18859 raft_consensus.cc:2804] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election won for term 1
12:14:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.020426 18859 raft_consensus.cc:697] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 LEADER]: Becoming Leader. State: Replica: 5f32f8c83f4c4a3e9837d363869a92cb, State: Running, Role: LEADER
12:14:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.021499 17612 raft_consensus.cc:2468] T 0b11d3194e5543248721bee067c8f278 P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f32f8c83f4c4a3e9837d363869a92cb in term 1.
12:14:36.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.021183 18859 consensus_queue.cc:237] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } }
12:14:36.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.022034 18872 leader_election.cc:290] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [CANDIDATE]: Term 1 election: Requested vote from peers e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67:34965), b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145)
12:14:36.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.027617 18858 raft_consensus.cc:493] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:36.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.028041 18858 raft_consensus.cc:515] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:36.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.029925 18858 leader_election.cc:290] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:36.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.032398 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.032081 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e98bc7615e4665a6e500c1cab31dda" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:36.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.032899 17423 catalog_manager.cc:5697] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66). New cstate: current_term: 1 leader_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: HEALTHY } } }
12:14:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.033838 17612 raft_consensus.cc:2393] T 18e98bc7615e4665a6e500c1cab31dda P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in current term 1: Already voted for candidate 5f32f8c83f4c4a3e9837d363869a92cb in this term.
12:14:36.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.034848 17830 leader_election.cc:304] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 5f32f8c83f4c4a3e9837d363869a92cb, b65f7d707d2a4b17b865e73c787428ee
12:14:36.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.035913 18858 raft_consensus.cc:3060] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:36.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.050422 18858 raft_consensus.cc:2749] T 18e98bc7615e4665a6e500c1cab31dda P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:36.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.072661 18859 consensus_queue.cc:1048] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.097548 18859 consensus_queue.cc:1048] T 18e98bc7615e4665a6e500c1cab31dda P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:36.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.121758 17894 raft_consensus.cc:3060] T a0e07e3365584bb38520a776f55ad0d2 P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.127255 18858 raft_consensus.cc:493] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.127641 18858 raft_consensus.cc:515] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.128036 18882 consensus_queue.cc:1048] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.129994 18858 leader_election.cc:290] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:36.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.130389 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" is_pre_election: true
12:14:36.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.130956 17755 raft_consensus.cc:2468] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in term 0.
12:14:36.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.130848 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee" is_pre_election: true
12:14:36.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.131744 17612 raft_consensus.cc:2468] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in term 0.
12:14:36.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.132261 17831 leader_election.cc:304] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f32f8c83f4c4a3e9837d363869a92cb, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 
12:14:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.133693 18858 raft_consensus.cc:2804] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.134125 18858 raft_consensus.cc:493] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.134441 18858 raft_consensus.cc:3060] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 0 FOLLOWER]: Advancing to term 1
12:14:36.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.138499 18858 raft_consensus.cc:515] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:36.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.141283 18858 leader_election.cc:290] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 election: Requested vote from peers b65f7d707d2a4b17b865e73c787428ee (127.16.194.65:46145), 5f32f8c83f4c4a3e9837d363869a92cb (127.16.194.66:35941)
12:14:36.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.141360 17612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b65f7d707d2a4b17b865e73c787428ee"
12:14:36.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.141873 17612 raft_consensus.cc:3060] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 0 FOLLOWER]: Advancing to term 1
12:14:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.145679 17755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74735e91682e470180aaef67e499fada" candidate_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f32f8c83f4c4a3e9837d363869a92cb"
12:14:36.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.146229 17755 raft_consensus.cc:3060] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 0 FOLLOWER]: Advancing to term 1
12:14:36.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.151932 17612 raft_consensus.cc:2468] T 74735e91682e470180aaef67e499fada P b65f7d707d2a4b17b865e73c787428ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in term 1.
12:14:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.153165 17830 leader_election.cc:304] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b65f7d707d2a4b17b865e73c787428ee, e97303c2e1ff42e8b6b9cb1d543e3f88; no voters: 
12:14:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.154336 18858 raft_consensus.cc:2804] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 FOLLOWER]: Leader election won for term 1
12:14:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.154805 18858 raft_consensus.cc:697] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [term 1 LEADER]: Becoming Leader. State: Replica: e97303c2e1ff42e8b6b9cb1d543e3f88, State: Running, Role: LEADER
12:14:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.155674 18858 consensus_queue.cc:237] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } }
12:14:36.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.156071 18882 consensus_queue.cc:1048] T a0e07e3365584bb38520a776f55ad0d2 P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.172796 17755 raft_consensus.cc:2468] T 74735e91682e470180aaef67e499fada P 5f32f8c83f4c4a3e9837d363869a92cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e97303c2e1ff42e8b6b9cb1d543e3f88 in term 1.
12:14:36.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.193420 17422 catalog_manager.cc:5697] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to e97303c2e1ff42e8b6b9cb1d543e3f88 (127.16.194.67). New cstate: current_term: 1 leader_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 } health_report { overall_health: HEALTHY } } }
12:14:36.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.204080 18859 consensus_queue.cc:1048] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.219 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:36.219 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:36.220 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:36.220 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.220 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.221 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.221 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.221 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:36.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.234048 18907 consensus_queue.cc:1048] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.235870 18872 consensus_queue.cc:1048] T 386b64c8ec0c469ebd53d12eadb01231 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.255745 18853 consensus_queue.cc:1048] T 4f7abeeb47504b5988bb5e1c49541acf P b65f7d707d2a4b17b865e73c787428ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.261 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:36.262 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:36.262 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:36.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.262 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:36.262 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:36.263 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:36.263 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.263 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.263 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.263 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.263 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.263 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.263 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:36.264 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.264 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:36.264 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.264 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:36.266 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.266 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.266 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:36.266 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:36.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:36.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:36.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.542754 18872 consensus_queue.cc:1048] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.557056 18859 consensus_queue.cc:1048] T 0b11d3194e5543248721bee067c8f278 P 5f32f8c83f4c4a3e9837d363869a92cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e97303c2e1ff42e8b6b9cb1d543e3f88" member_type: VOTER last_known_addr { host: "127.16.194.67" port: 34965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.559 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:36.559 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:36.559 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:36.560 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:36.560 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:36.560 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:36.560 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:36.560 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:36.560 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:36.565 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:36.565 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:36.565 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:36.565 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:36.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.581311 18858 consensus_queue.cc:1048] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f32f8c83f4c4a3e9837d363869a92cb" member_type: VOTER last_known_addr { host: "127.16.194.66" port: 35941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:36.621 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:36.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:36.613755 18858 consensus_queue.cc:1048] T 74735e91682e470180aaef67e499fada P e97303c2e1ff42e8b6b9cb1d543e3f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b65f7d707d2a4b17b865e73c787428ee" member_type: VOTER last_known_addr { host: "127.16.194.65" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
12:14:36.751 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:36.751 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:36.751 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:36.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:36.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:36.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:36.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:36.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:36.752 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:36.752 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:36.752 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:36.752 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:36.752 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:36.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:36.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.111 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:37.112 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:37.112 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:37.112 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.112 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.112 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.112 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.112 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.112 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.112 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.112 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.112 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:37.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.261 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:37.261 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:37.261 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:37.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:37.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:37.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:37.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:37.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:37.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:37.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:37.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:37.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:37.262 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:37.285 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:37.285 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:37.285 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:37.286 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:37.286 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:37.286 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:37.286 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:37.286 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:37.286 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:37.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:37.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:37.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:37.286 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:37.334 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.347 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:37.347 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:37.347 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:37.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.348 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.348 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.348 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.348 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.348 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.348 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.348 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.348 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.348 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:37.570 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:37.570 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:37.570 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:37.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.571 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.571 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.571 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.571 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.571 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.571 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.571 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.571 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.571 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:37.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:37.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:37.692 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:37.693 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.693 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.693 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.693 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:37.693 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.693 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:37.693 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:37.694 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:37.799 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:37.800 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:37.800 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:37.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.800 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:37.834 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:37.906 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:37.907 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:37.907 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:37.907 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.907 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.907 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.907 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.907 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:37.907 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.907 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:37.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.908 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:37.908 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:38.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.121 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:38.125 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:38.126 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:38.126 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC GetTableLocations: received response from server master-127.16.194.124:36205: OK, deferred=null) after lookup
12:14:38.126 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] connecting to peer
12:14:38.128 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] Successfully connected to peer
12:14:38.139 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.142 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf0b90a5a, L:/127.0.0.1:60458 - R:/127.16.194.66:35941] using TOKEN/null
12:14:38.180 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:38.181 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:38.181 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:38.181 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.181 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.181 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.181 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.181 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.182 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.182 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:38.287 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:38.288 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:38.288 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:38.288 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:38.288 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:38.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:38.289 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:38.289 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:38.289 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:38.289 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:38.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:38.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:38.289 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:38.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.361 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:38.361 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:38.361 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:38.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.362 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.363 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:38.423 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:38.427 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:38.431 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:38.431 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:38.432 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:38.435 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:38.437 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:38.437 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:38.438 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:38.446 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.455 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:38.465 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:38.465 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:38.465 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:38.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:38.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:38.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:38.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:38.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:38.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:38.467 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:38.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:38.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:38.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:38.467 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7030d5ad, L:/127.0.0.1:51712 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:38.479 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:38.481 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.486 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb6a4fa79, L:/127.0.0.1:58962 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:38.493 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.499 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xce692b4d, L:/127.0.0.1:52714 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:38.503 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:38.503 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=76), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: OK, [73ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:38.508 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:38.508 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:38.509 [DEBUG - main] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:38.509 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:38.509 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:38.509 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:38.509 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.16.194.124:36205(127.16.194.124:36205)] Successfully connected to peer
12:14:38.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.510 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:38.510 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.510 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.510 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:38.510 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.511 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.511 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:38.511 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:38.511 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.16.194.126:33897(127.16.194.126:33897)] Successfully connected to peer
12:14:38.517 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.16.194.125:40961(127.16.194.125:40961)] Successfully connected to peer
12:14:38.519 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.126
12:14:38.520 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.125
12:14:38.526 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.124
12:14:38.530 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.535 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc698e61b, L:/127.0.0.1:44132 - R:/127.16.194.125:40961] using SASL/PLAIN
12:14:38.541 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.544 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x15af7295, L:/127.0.0.1:55096 - R:/127.16.194.126:33897] using SASL/PLAIN
12:14:38.545 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:38.549 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcba155c1, L:/127.0.0.1:43806 - R:/127.16.194.124:36205] using SASL/PLAIN
12:14:38.554 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:38.555 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=47), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [32ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: OK, deferred=null) after lookup
12:14:38.559 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:38.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:38.567 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.571115 18220 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52714:
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:14:38.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\0012\000\000\000"
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:14:38.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:14:38.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:38.577611 18220 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:14:38.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.660 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:38.710 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:38.710 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:38.710 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:38.710 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.710 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.710 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.711 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.711 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.713 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.713 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.713 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:38.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.718842 18606 tablet_service.cc:1511] Processing CreateTablet for tablet 01a8562a1d6c431db04d9d4947215e7b (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:38.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.721840 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8562a1d6c431db04d9d4947215e7b. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.726857 18605 tablet_service.cc:1511] Processing CreateTablet for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:38.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.728129 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.751319 18748 tablet_service.cc:1511] Processing CreateTablet for tablet 01a8562a1d6c431db04d9d4947215e7b (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:38.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.753248 18748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8562a1d6c431db04d9d4947215e7b. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.754202 18747 tablet_service.cc:1511] Processing CreateTablet for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:38.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.755338 18747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.767158 18389 tablet_service.cc:1511] Processing CreateTablet for tablet 01a8562a1d6c431db04d9d4947215e7b (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION VALUES < 50
12:14:38.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.770560 18388 tablet_service.cc:1511] Processing CreateTablet for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION VALUES < 50
12:14:38.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.779091 18388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d791a6cfc10469bb128ef6a9e6ab5f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.788832 18389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8562a1d6c431db04d9d4947215e7b. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:38.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.804329 18975 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:38.809 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:38.809 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:38.809 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:38.810 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.810 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.810 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.810 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.810 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.810 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.810 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.810 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.810 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.810 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:38.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.810655 18974 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:38.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.815187 18975 tablet_bootstrap.cc:654] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:38.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.817780 18975 log.cc:826] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: Log is configured to *not* fsync() on all Append() calls
12:14:38.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.817938 18974 tablet_bootstrap.cc:654] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:38.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.820148 18974 log.cc:826] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: Log is configured to *not* fsync() on all Append() calls
12:14:38.835 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:38.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.840994 18974 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:38.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.841531 18974 ts_tablet_manager.cc:1403] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
12:14:38.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.859346 18978 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:38.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.862223 18975 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:38.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.862756 18975 ts_tablet_manager.cc:1403] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.020s
12:14:38.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.867579 18978 tablet_bootstrap.cc:654] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:38.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.870014 18978 log.cc:826] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Log is configured to *not* fsync() on all Append() calls
12:14:38.871 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:38.871 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:38.871 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:38.872 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.872 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.872 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:38.872 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.873 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.873 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:38.877 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.877 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.877 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:38.877 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:38.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.877354 18974 raft_consensus.cc:359] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:38.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.878237 18974 raft_consensus.cc:385] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:38.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.878530 18974 raft_consensus.cc:740] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:38.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.879544 18974 consensus_queue.cc:260] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:38.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.889766 18974 ts_tablet_manager.cc:1434] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.048s	user 0.034s	sys 0.004s
12:14:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.890798 18974 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.893792 18978 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:38.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.894308 18978 ts_tablet_manager.cc:1403] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.016s
12:14:38.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.899317 18974 tablet_bootstrap.cc:654] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:38.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.911566 18974 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:38.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.912011 18974 ts_tablet_manager.cc:1403] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
12:14:38.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.914696 18974 raft_consensus.cc:359] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:38.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.916057 18974 raft_consensus.cc:385] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:38.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.916361 18974 raft_consensus.cc:740] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:38.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.917573 18980 raft_consensus.cc:493] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:38.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.918082 18980 raft_consensus.cc:515] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:38.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.921844 18980 leader_election.cc:290] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:38.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.917033 18974 consensus_queue.cc:260] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:38.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.924548 18974 ts_tablet_manager.cc:1434] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
12:14:38.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.933024 18975 raft_consensus.cc:359] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:38.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.933960 18975 raft_consensus.cc:385] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:38.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.934258 18975 raft_consensus.cc:740] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:38.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.935367 18975 consensus_queue.cc:260] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:38.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.947355 18975 ts_tablet_manager.cc:1434] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.084s	user 0.038s	sys 0.003s
12:14:38.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.961045 18975 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:38.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.965471 18978 raft_consensus.cc:359] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:38.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.966496 18978 raft_consensus.cc:385] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:38.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.966861 18978 raft_consensus.cc:740] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:38.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.967387 18409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d791a6cfc10469bb128ef6a9e6ab5f2" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936" is_pre_election: true
12:14:38.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.967869 18978 consensus_queue.cc:260] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:38.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:38.970177 18561 leader_election.cc:343] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465): Illegal state: must be running to vote when last-logged opid is not known
12:14:38.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.971449 18975 tablet_bootstrap.cc:654] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:38.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.975873 18978 ts_tablet_manager.cc:1434] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.081s	user 0.023s	sys 0.014s
12:14:38.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.978534 18978 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:38.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.984473 18978 tablet_bootstrap.cc:654] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.984822 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d791a6cfc10469bb128ef6a9e6ab5f2" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.985750 18768 raft_consensus.cc:2468] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 0.
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.987176 18561 leader_election.cc:304] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 95706152c43f41ab8b4c6037c07ea936
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.988498 18980 raft_consensus.cc:2804] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.988886 18980 raft_consensus.cc:493] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:38.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.989214 18980 raft_consensus.cc:3060] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:38.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:38.994117 18678 tablet.cc:2406] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:38.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.996127 18978 tablet_bootstrap.cc:492] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:38.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:38.996548 18978 ts_tablet_manager.cc:1403] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
12:14:39.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.000574 18978 raft_consensus.cc:359] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.001252 18978 raft_consensus.cc:385] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:39.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.001506 18978 raft_consensus.cc:740] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:39.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.002264 18978 consensus_queue.cc:260] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.004501 18978 ts_tablet_manager.cc:1434] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
12:14:39.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.008834 18975 tablet_bootstrap.cc:492] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:39.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.009243 18975 ts_tablet_manager.cc:1403] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.018s
12:14:39.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.010632 18980 raft_consensus.cc:515] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.011857 18975 raft_consensus.cc:359] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:39.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.012487 18975 raft_consensus.cc:385] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:39.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.012769 18975 raft_consensus.cc:740] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:39.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.013171 18980 leader_election.cc:290] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 election: Requested vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:39.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.013573 18975 consensus_queue.cc:260] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:39.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.016140 18409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d791a6cfc10469bb128ef6a9e6ab5f2" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:39.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.016716 18409 raft_consensus.cc:3060] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:39.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.022986 18975 ts_tablet_manager.cc:1434] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
12:14:39.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.023469 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d791a6cfc10469bb128ef6a9e6ab5f2" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e"
12:14:39.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.023878 18409 raft_consensus.cc:2468] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 1.
12:14:39.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.023962 18768 raft_consensus.cc:3060] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:39.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.025190 18561 leader_election.cc:304] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: 
12:14:39.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.036468 18980 raft_consensus.cc:2804] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election won for term 1
12:14:39.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.037978 18768 raft_consensus.cc:2468] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 1.
12:14:39.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.039101 18980 raft_consensus.cc:697] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [term 1 LEADER]: Becoming Leader. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Running, Role: LEADER
12:14:39.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.040050 18980 consensus_queue.cc:237] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.050712 18219 catalog_manager.cc:5697] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e reported cstate change: term changed from 0 to 1, leader changed from <none> to 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194). New cstate: current_term: 1 leader_uuid: "414328f38a134d6eaa3ce2c7212c587e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: UNKNOWN } } }
12:14:39.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:39.073843 18461 tablet.cc:2406] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:39.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:39.109674 18820 tablet.cc:2406] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:39.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:39.120 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:39.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:39.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:39.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:39.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:39.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:39.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:39.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:39.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:39.121 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:39.121 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:39.121 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:39.121 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:39.150 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:39.150 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:39.150 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:39.150 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.150 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.150 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.150 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.151 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.151 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.151 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.151 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.151 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.151 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:39.220 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:39.221 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:39.221 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:39.221 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:39.221 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:39.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:39.221 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:39.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:39.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:39.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:39.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:39.222 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:39.222 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:39.269 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:39.269 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:39.270 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:39.270 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.270 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.270 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.270 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.270 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.270 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.271 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.271 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:39.335 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:39.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:39.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.357095 18980 raft_consensus.cc:493] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:39.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.357501 18980 raft_consensus.cc:515] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:39.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.359072 18980 leader_election.cc:290] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a23113f6788a4602994404c467dee91e (127.17.135.195:35771), 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465)
12:14:39.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.359798 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a8562a1d6c431db04d9d4947215e7b" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:39.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.360278 18768 raft_consensus.cc:2468] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 0.
12:14:39.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.360172 18409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a8562a1d6c431db04d9d4947215e7b" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936" is_pre_election: true
12:14:39.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.360726 18409 raft_consensus.cc:2468] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 0.
12:14:39.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.361110 18561 leader_election.cc:304] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 
12:14:39.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.361749 18980 raft_consensus.cc:2804] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:39.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.362059 18980 raft_consensus.cc:493] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:39.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.362334 18980 raft_consensus.cc:3060] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:39.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.366380 18980 raft_consensus.cc:515] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:39.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.367864 18980 leader_election.cc:290] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 election: Requested vote from peers a23113f6788a4602994404c467dee91e (127.17.135.195:35771), 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465)
12:14:39.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.368464 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a8562a1d6c431db04d9d4947215e7b" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e"
12:14:39.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.368856 18409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a8562a1d6c431db04d9d4947215e7b" candidate_uuid: "414328f38a134d6eaa3ce2c7212c587e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:39.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.368968 18768 raft_consensus.cc:3060] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:39.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.369210 18409 raft_consensus.cc:3060] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:39.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.372998 18768 raft_consensus.cc:2468] T 01a8562a1d6c431db04d9d4947215e7b P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 1.
12:14:39.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.373818 18561 leader_election.cc:304] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 
12:14:39.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.374559 18980 raft_consensus.cc:2804] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election won for term 1
12:14:39.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.374620 18409 raft_consensus.cc:2468] T 01a8562a1d6c431db04d9d4947215e7b P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414328f38a134d6eaa3ce2c7212c587e in term 1.
12:14:39.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.374965 18980 raft_consensus.cc:697] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [term 1 LEADER]: Becoming Leader. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Running, Role: LEADER
12:14:39.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.376083 18980 consensus_queue.cc:237] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } }
12:14:39.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.387037 18219 catalog_manager.cc:5697] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e reported cstate change: term changed from 0 to 1, leader changed from <none> to 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194). New cstate: current_term: 1 leader_uuid: "414328f38a134d6eaa3ce2c7212c587e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: UNKNOWN } } }
12:14:39.461 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:39.461 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:39.461 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:39.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.462 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.462 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.462 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.462 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.462 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.462 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.462 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:39.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.577080 18980 consensus_queue.cc:1048] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:39.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.607070 18980 consensus_queue.cc:1048] T 3d791a6cfc10469bb128ef6a9e6ab5f2 P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:39.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:39.672 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:39.672 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:39.672 [DEBUG - pool-142-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:39.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.672 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.672 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.673 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:39.673 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=27928), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [35ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [52ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [53ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [54ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] refreshing cache from master, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] refreshing cache from master, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [484ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [486ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [961ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1780ms] refreshing cache from master, [1780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3380ms] refreshing cache from master, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1020026161(state=PENDING, result=null, callback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785), errback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785)))
12:14:39.674 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:39.674 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=27928), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [35ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [52ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [53ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [54ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] refreshing cache from master, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] refreshing cache from master, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [484ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [486ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [961ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1780ms] refreshing cache from master, [1780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3380ms] refreshing cache from master, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1020026161(state=PENDING, result=null, callback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785), errback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:39.674 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
12:14:39.676 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
12:14:39.678 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=20, TimeoutTracker(timeout=30000, elapsed=27928), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [35ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [52ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [53ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [54ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] refreshing cache from master, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [89ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [89ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] refreshing cache from master, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [483ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [484ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [484ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [485ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [486ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [486ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [961ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1780ms] refreshing cache from master, [1780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3380ms] refreshing cache from master, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1020026161(state=PENDING, result=null, callback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785), errback=(continuation of Deferred@349507537 after retry RPC after error@1128923573) -> (continuation of Deferred@1961830944 after retry RPC after error@714392665) -> (continuation of Deferred@369360221 after retry RPC after error@89588097) -> (continuation of Deferred@140805409 after retry RPC after error@81673848) -> (continuation of Deferred@230605483 after retry RPC after error@819495316) -> (continuation of Deferred@481908515 after retry RPC after error@1768003378) -> (continuation of Deferred@313633583 after retry RPC after error@1712413900) -> (continuation of Deferred@809967458 after retry RPC after error@1442498143) -> (continuation of Deferred@1250817820 after retry RPC after error@647374269) -> (continuation of Deferred@774017538 after retry RPC after error@761880999) -> (continuation of Deferred@150558209 after retry RPC after error@534061422) -> (continuation of Deferred@626852372 after retry RPC after error@1138699073) -> (continuation of Deferred@22295653 after retry RPC after error@935111536) -> (continuation of Deferred@2059162161 after retry RPC after error@1082387204) -> (continuation of Deferred@1616119917 after retry RPC after error@853657660) -> (continuation of Deferred@718551435 after retry RPC after error@1968188446) -> (continuation of Deferred@898061753 after retry RPC after error@152816413) -> (continuation of Deferred@42509268 after retry RPC after error@1984712519) -> (continuation of Deferred@2045372074 after retry RPC after error@788367785)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:39.679 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:39.679 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
12:14:39.679 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
12:14:39.679 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:14:39.770 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:39.770 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:39.771 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:39.771 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.771 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.771 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.771 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:39.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.775621 18220 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52714:
12:14:39.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\0012\000\000\000\007\001\226\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
12:14:39.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:39.797091 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e28ef28002144c494838792109461cd has no consensus state
12:14:39.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:39.798441 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ae4e19d6d944f36af588d41dc8f2593 has no consensus state
12:14:39.820 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:39.820 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:39.820 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:39.821 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.821 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.821 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:39.821 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.821 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.821 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:39.822 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.822 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.822 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:39.822 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:39.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.819207 18388 tablet_service.cc:1511] Processing CreateTablet for tablet 2e28ef28002144c494838792109461cd (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.820498 18388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e28ef28002144c494838792109461cd. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.824012 18606 tablet_service.cc:1511] Processing CreateTablet for tablet 2e28ef28002144c494838792109461cd (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.825232 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e28ef28002144c494838792109461cd. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:39.829406 18204 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 2e28ef28002144c494838792109461cd (table replication_test_table [id=558f97b6f817406587f99c961107450b], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2e28ef28002144c494838792109461cd consensus state has no leader
12:14:39.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:39.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.842869 18747 tablet_service.cc:1511] Processing CreateTablet for tablet 2e28ef28002144c494838792109461cd (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.844079 18747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e28ef28002144c494838792109461cd. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.847 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:39.847 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:39.847 [DEBUG - pool-140-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:39.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.846850 18389 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae4e19d6d944f36af588d41dc8f2593 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.848006 18389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae4e19d6d944f36af588d41dc8f2593. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.848 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.848 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.848 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:39.848 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.848 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.848 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:39.848 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:39.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:39.849 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28121), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [8ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [47ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [114ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [115ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [164ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [682ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [682ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [981ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1042ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2862ms] too many traces: truncated at 100 traces, deferred=Deferred@1821198960(state=PENDING, result=null, callback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578), errback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578)))
12:14:39.850 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:39.850 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:39.850 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:39.850 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:39.850 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.850 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28121), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [8ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [47ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [114ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [115ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [164ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [682ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [682ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [981ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1042ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2862ms] too many traces: truncated at 100 traces, deferred=Deferred@1821198960(state=PENDING, result=null, callback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578), errback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:39.947 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
12:14:39.948 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.948 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.948 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.949 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.949 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.949 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.949 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:39.950 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:39.950 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:39.950 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.950 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.950 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.861572 19003 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.866240 19004 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.868199 19003 tablet_bootstrap.cc:654] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.872129 19004 tablet_bootstrap.cc:654] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.876282 18605 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae4e19d6d944f36af588d41dc8f2593 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.877507 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae4e19d6d944f36af588d41dc8f2593. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.879714 18747 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae4e19d6d944f36af588d41dc8f2593 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 50 <= VALUES < 150
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.880899 18747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae4e19d6d944f36af588d41dc8f2593. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.891616 18980 consensus_queue.cc:1048] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.913156 18988 consensus_queue.cc:1048] T 01a8562a1d6c431db04d9d4947215e7b P 414328f38a134d6eaa3ce2c7212c587e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.938585 19004 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.939039 19004 ts_tablet_manager.cc:1403] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.000s
12:14:39.952 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
12:14:39.947 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.952 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.952 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:39.954 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28121), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [8ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [10ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [26ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [28ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [47ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [114ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [115ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [164ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [681ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [682ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [682ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [981ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1040ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1041ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1042ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2862ms] too many traces: truncated at 100 traces, deferred=Deferred@1821198960(state=PENDING, result=null, callback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578), errback=(continuation of Deferred@320739858 after retry RPC after error@1321736064) -> (continuation of Deferred@784109538 after retry RPC after error@677678735) -> (continuation of Deferred@1271521051 after retry RPC after error@1169401333) -> (continuation of Deferred@255516990 after retry RPC after error@61216416) -> (continuation of Deferred@101851336 after retry RPC after error@1591124466) -> (continuation of Deferred@113088519 after retry RPC after error@899517798) -> (continuation of Deferred@580841341 after retry RPC after error@1227625453) -> (continuation of Deferred@591124335 after retry RPC after error@2056554707) -> (continuation of Deferred@790918651 after retry RPC after error@104769673) -> (continuation of Deferred@2076411790 after retry RPC after error@625953333) -> (continuation of Deferred@692611274 after retry RPC after error@1522657162) -> (continuation of Deferred@1029301419 after retry RPC after error@1645748183) -> (continuation of Deferred@150742374 after retry RPC after error@1565818436) -> (continuation of Deferred@802858489 after retry RPC after error@228516210) -> (continuation of Deferred@1679831730 after retry RPC after error@452515372) -> (continuation of Deferred@1626824167 after retry RPC after error@437827066) -> (continuation of Deferred@2135466409 after retry RPC after error@593314266) -> (continuation of Deferred@2040473651 after retry RPC after error@653784479) -> (continuation of Deferred@470306049 after retry RPC after error@1427279051) -> (continuation of Deferred@1431103722 after retry RPC after error@1276028113) -> (continuation of Deferred@305174548 after retry RPC after error@1401236045) -> (continuation of Deferred@1631359855 after retry RPC after error@1487768501) -> (continuation of Deferred@1313556620 after retry RPC after error@887542858) -> (continuation of Deferred@826580562 after retry RPC after error@92294124) -> (continuation of Deferred@295398648 after retry RPC after error@333295109) -> (continuation of Deferred@108925986 after retry RPC after error@27713578)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:39.955 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:39.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:39.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:39.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.953723 19003 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.954169 19003 ts_tablet_manager.cc:1403] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.023s
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.957054 19003 raft_consensus.cc:359] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.957765 19003 raft_consensus.cc:385] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.958029 19003 raft_consensus.cc:740] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.958761 19003 consensus_queue.cc:260] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.961074 19003 ts_tablet_manager.cc:1434] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.962110 19003 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.969687 19003 tablet_bootstrap.cc:654] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:39.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.975610 19004 raft_consensus.cc:359] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.976294 19004 raft_consensus.cc:385] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:39.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.976548 19004 raft_consensus.cc:740] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:39.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.985862 19004 consensus_queue.cc:260] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:39.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.993857 19004 ts_tablet_manager.cc:1434] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
12:14:39.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.996073 19004 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:39.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.998224 19003 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:39.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.998615 19003 ts_tablet_manager.cc:1403] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
12:14:40.003 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
12:14:40.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.001184 19003 raft_consensus.cc:359] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.002698 19003 raft_consensus.cc:385] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.002938 19003 raft_consensus.cc:740] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:40.005 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
12:14:40.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.006196 19003 consensus_queue.cc:260] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.011251 19003 ts_tablet_manager.cc:1434] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
12:14:40.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:39.945281 19002 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:40.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.026738 19002 tablet_bootstrap.cc:654] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:40.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.030616 19004 tablet_bootstrap.cc:654] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:40.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.044402 19002 tablet_bootstrap.cc:492] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:40.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.045095 19002 ts_tablet_manager.cc:1403] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.007s
12:14:40.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.046111 18220 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: replication_test_table [id=558f97b6f817406587f99c961107450b] alter complete (version 0)
12:14:40.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.048180 19002 raft_consensus.cc:359] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.049079 19002 raft_consensus.cc:385] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.049530 19002 raft_consensus.cc:740] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:40.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.050475 19002 consensus_queue.cc:260] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.055491 19004 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:40.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.055894 19004 ts_tablet_manager.cc:1403] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.060s	user 0.000s	sys 0.013s
12:14:40.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.056262 19002 ts_tablet_manager.cc:1434] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
12:14:40.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.062036 18220 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52714:
12:14:40.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\226\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
12:14:40.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.063954 19002 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:40.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.070350 19002 tablet_bootstrap.cc:654] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:40.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.071075 19004 raft_consensus.cc:359] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.071774 19004 raft_consensus.cc:385] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.072121 19004 raft_consensus.cc:740] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:40.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.072791 19004 consensus_queue.cc:260] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.080597 19004 ts_tablet_manager.cc:1434] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
12:14:40.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:40.087396 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e28ef28002144c494838792109461cd consensus state has no leader
12:14:40.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:40.087981 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 767e235fa4084d34a4e3b5d8f3c13bf6 has no consensus state
12:14:40.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:40.089944 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ae4e19d6d944f36af588d41dc8f2593 consensus state has no leader
12:14:40.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:40.090427 18220 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36052c1a2c8c4d49ba87705834e15b86 has no consensus state
12:14:40.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.104631 19002 tablet_bootstrap.cc:492] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:40.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.105130 19002 ts_tablet_manager.cc:1403] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.008s
12:14:40.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.108996 19002 raft_consensus.cc:359] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.109691 19002 raft_consensus.cc:385] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.110054 19002 raft_consensus.cc:740] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:40.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.110733 19002 consensus_queue.cc:260] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.113036 19002 ts_tablet_manager.cc:1434] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
12:14:40.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.117853 18993 raft_consensus.cc:493] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.118335 18993 raft_consensus.cc:515] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.121767 18993 leader_election.cc:290] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.126809 18993 raft_consensus.cc:493] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.128161 18997 raft_consensus.cc:493] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.128705 18997 raft_consensus.cc:515] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.131106 18993 raft_consensus.cc:515] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.133476 18747 tablet_service.cc:1511] Processing CreateTablet for tablet 767e235fa4084d34a4e3b5d8f3c13bf6 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.133966 18993 leader_election.cc:290] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.133795 18389 tablet_service.cc:1511] Processing CreateTablet for tablet 767e235fa4084d34a4e3b5d8f3c13bf6 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.134632 18747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767e235fa4084d34a4e3b5d8f3c13bf6. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.135027 18389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767e235fa4084d34a4e3b5d8f3c13bf6. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.137732 18605 tablet_service.cc:1511] Processing CreateTablet for tablet 767e235fa4084d34a4e3b5d8f3c13bf6 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 0, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.138850 18605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 767e235fa4084d34a4e3b5d8f3c13bf6. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.141397 18997 leader_election.cc:290] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.148816 18388 tablet_service.cc:1511] Processing CreateTablet for tablet 36052c1a2c8c4d49ba87705834e15b86 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.150010 18388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36052c1a2c8c4d49ba87705834e15b86. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.152102 18748 tablet_service.cc:1511] Processing CreateTablet for tablet 36052c1a2c8c4d49ba87705834e15b86 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.153314 18748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36052c1a2c8c4d49ba87705834e15b86. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.153035 18606 tablet_service.cc:1511] Processing CreateTablet for tablet 36052c1a2c8c4d49ba87705834e15b86 (DEFAULT_TABLE table=replication_test_table [id=558f97b6f817406587f99c961107450b]), partition=HASH (key2) PARTITION 1, RANGE (key1) PARTITION 150 <= VALUES
12:14:40.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.154173 18606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36052c1a2c8c4d49ba87705834e15b86. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:40.161 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:40.161 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:40.161 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:40.161 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:40.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:40.161 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:40.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:40.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:40.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:40.162 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:40.162 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:40.162 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:40.162 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:40.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.163614 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.165292 19002 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:40.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.165339 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.166038 18625 raft_consensus.cc:2468] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23113f6788a4602994404c467dee91e in term 0.
12:14:40.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.164389 18626 raft_consensus.cc:2468] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23113f6788a4602994404c467dee91e in term 0.
12:14:40.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.169057 18704 leader_election.cc:304] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 
12:14:40.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.172066 18993 raft_consensus.cc:2804] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:40.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.172441 18993 raft_consensus.cc:493] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:40.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.172915 18993 raft_consensus.cc:3060] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.177342 18704 leader_election.cc:304] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 
12:14:40.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.179944 18997 raft_consensus.cc:493] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.180362 18997 raft_consensus.cc:515] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.182196 18997 leader_election.cc:290] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.187642 19003 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:40.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.189813 18993 raft_consensus.cc:515] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.195044 19003 tablet_bootstrap.cc:654] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:40.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.197504 19004 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:40.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.195101 18993 leader_election.cc:290] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 election: Requested vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:40.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.200403 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:40.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.201025 18626 raft_consensus.cc:3060] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.199276 19020 raft_consensus.cc:2804] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:40.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.204170 19004 tablet_bootstrap.cc:654] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:40.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.204548 19020 raft_consensus.cc:493] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:40.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.205032 19020 raft_consensus.cc:3060] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.206938 19002 tablet_bootstrap.cc:654] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:40.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.207527 18626 raft_consensus.cc:2468] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23113f6788a4602994404c467dee91e in term 1.
12:14:40.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.214160 19003 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:40.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.214593 19003 ts_tablet_manager.cc:1403] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.008s
12:14:40.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.217382 19003 raft_consensus.cc:359] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.218093 19003 raft_consensus.cc:385] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.218364 19003 raft_consensus.cc:740] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:40.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.219046 19003 consensus_queue.cc:260] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.225198 19003 ts_tablet_manager.cc:1434] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
12:14:40.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.230432 19003 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936: Bootstrap starting.
12:14:40.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.236469 19003 tablet_bootstrap.cc:654] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936: Neither blocks nor log segments found. Creating new log.
12:14:40.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.236195 18704 leader_election.cc:304] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e; no voters: 
12:14:40.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:40.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.258654 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.259490 18625 raft_consensus.cc:2393] T 2e28ef28002144c494838792109461cd P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95706152c43f41ab8b4c6037c07ea936 in current term 1: Already voted for candidate a23113f6788a4602994404c467dee91e in this term.
12:14:40.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:40.261 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:40.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:40.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:40.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:40.263 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:40.263 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:40.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:40.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.262842 18626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.263 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:40.263 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:40.263 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:40.263 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:40.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.264156 18626 raft_consensus.cc:2468] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 0.
12:14:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.265411 19002 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.265815 19002 ts_tablet_manager.cc:1403] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.002s
12:14:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.265769 18345 leader_election.cc:304] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: 
12:14:40.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.266752 18997 raft_consensus.cc:2804] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:40.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.267103 18997 raft_consensus.cc:493] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:40.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.267400 18997 raft_consensus.cc:3060] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:40.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.269397 19003 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936: No bootstrap required, opened a new log
12:14:40.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.269784 19003 ts_tablet_manager.cc:1403] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
12:14:40.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.250052 18993 raft_consensus.cc:2804] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election won for term 1
12:14:40.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.268368 19002 raft_consensus.cc:359] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.271590 19002 raft_consensus.cc:385] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.271905 19002 raft_consensus.cc:740] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:40.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.272567 19002 consensus_queue.cc:260] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.274691 18997 raft_consensus.cc:515] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.277669 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.278160 18625 raft_consensus.cc:3060] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.285614 19002 ts_tablet_manager.cc:1434] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.286139 19003 raft_consensus.cc:359] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.286813 19003 raft_consensus.cc:385] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.287075 19003 raft_consensus.cc:740] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Initialized, Role: FOLLOWER
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.288462 19027 raft_consensus.cc:493] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.288897 19027 raft_consensus.cc:515] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.294981 19002 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e: Bootstrap starting.
12:14:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.298460 18768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.299494 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.261027 19004 tablet_bootstrap.cc:492] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.300760 19004 ts_tablet_manager.cc:1403] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.007s
12:14:40.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.244671 19020 raft_consensus.cc:515] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.304816 18768 raft_consensus.cc:2393] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95706152c43f41ab8b4c6037c07ea936 in current term 1: Already voted for candidate a23113f6788a4602994404c467dee91e in this term.
12:14:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.304777 18625 raft_consensus.cc:2468] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 1.
12:14:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.291041 18409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936" is_pre_election: true
12:14:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.307241 18409 raft_consensus.cc:2393] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a23113f6788a4602994404c467dee91e in current term 1: Already voted for candidate 95706152c43f41ab8b4c6037c07ea936 in this term.
12:14:40.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.301626 18407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:40.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.307552 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e"
12:14:40.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.308022 18407 raft_consensus.cc:3060] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:40.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.308347 18766 raft_consensus.cc:2393] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95706152c43f41ab8b4c6037c07ea936 in current term 1: Already voted for candidate a23113f6788a4602994404c467dee91e in this term.
12:14:40.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.309331 18997 leader_election.cc:290] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Requested vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.303325 18408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e28ef28002144c494838792109461cd" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936" is_pre_election: true
12:14:40.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.313241 19027 leader_election.cc:290] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.313879 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:40.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.314689 18625 raft_consensus.cc:2393] T 9ae4e19d6d944f36af588d41dc8f2593 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a23113f6788a4602994404c467dee91e in current term 1: Already voted for candidate 95706152c43f41ab8b4c6037c07ea936 in this term.
12:14:40.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.315095 18407 raft_consensus.cc:2468] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23113f6788a4602994404c467dee91e in term 1.
12:14:40.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.295558 19003 consensus_queue.cc:260] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.316109 18993 raft_consensus.cc:697] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [term 1 LEADER]: Becoming Leader. State: Replica: a23113f6788a4602994404c467dee91e, State: Running, Role: LEADER
12:14:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.306382 18345 leader_election.cc:304] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: 
12:14:40.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.317117 18993 consensus_queue.cc:237] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.319280 19020 leader_election.cc:290] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 election: Requested vote from peers 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465), 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601)
12:14:40.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.320647 18766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767e235fa4084d34a4e3b5d8f3c13bf6" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:40.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.321964 19004 raft_consensus.cc:359] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.322672 19004 raft_consensus.cc:385] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.323163 19004 raft_consensus.cc:740] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:40.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.324550 19002 tablet_bootstrap.cc:654] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e: Neither blocks nor log segments found. Creating new log.
12:14:40.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.324095 19004 consensus_queue.cc:260] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:40.325557 18344 leader_election.cc:343] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a23113f6788a4602994404c467dee91e (127.17.135.195:35771): Illegal state: must be running to vote when last-logged opid is not known
12:14:40.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.326298 19004 ts_tablet_manager.cc:1434] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
12:14:40.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.326297 19027 raft_consensus.cc:2804] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election won for term 1
12:14:40.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.327775 19004 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e: Bootstrap starting.
12:14:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.327869 19027 raft_consensus.cc:697] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [term 1 LEADER]: Becoming Leader. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Running, Role: LEADER
12:14:40.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.329165 19027 consensus_queue.cc:237] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.330366 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767e235fa4084d34a4e3b5d8f3c13bf6" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.330933 18625 raft_consensus.cc:2468] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 0.
12:14:40.343 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:40.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.345835 18220 catalog_manager.cc:5697] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e reported cstate change: term changed from 0 to 1, leader changed from <none> to a23113f6788a4602994404c467dee91e (127.17.135.195). New cstate: current_term: 1 leader_uuid: "a23113f6788a4602994404c467dee91e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: HEALTHY } } }
12:14:40.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.347783 18344 leader_election.cc:304] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95706152c43f41ab8b4c6037c07ea936; no voters: 414328f38a134d6eaa3ce2c7212c587e, a23113f6788a4602994404c467dee91e
12:14:40.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.348562 18997 raft_consensus.cc:2749] T 2e28ef28002144c494838792109461cd P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:14:40.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.351334 19002 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e: No bootstrap required, opened a new log
12:14:40.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.351899 19002 ts_tablet_manager.cc:1403] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.008s
12:14:40.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.358563 19004 tablet_bootstrap.cc:654] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e: Neither blocks nor log segments found. Creating new log.
12:14:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.377605 19002 raft_consensus.cc:359] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.379276 19002 raft_consensus.cc:385] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.389756 19004 tablet_bootstrap.cc:492] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e: No bootstrap required, opened a new log
12:14:40.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.390429 19004 ts_tablet_manager.cc:1403] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.000s
12:14:40.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.380082 19002 raft_consensus.cc:740] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414328f38a134d6eaa3ce2c7212c587e, State: Initialized, Role: FOLLOWER
12:14:40.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.392961 19002 consensus_queue.cc:260] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.396167 18218 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2979747c46f74287ae6fc30bbc08fc54: replication_test_table [id=558f97b6f817406587f99c961107450b] alter complete (version 0)
12:14:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.397526 19004 raft_consensus.cc:359] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.398176 19004 raft_consensus.cc:385] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.398425 19004 raft_consensus.cc:740] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23113f6788a4602994404c467dee91e, State: Initialized, Role: FOLLOWER
12:14:40.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.399217 19004 consensus_queue.cc:260] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.405704 19004 ts_tablet_manager.cc:1434] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
12:14:40.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.429493 19002 ts_tablet_manager.cc:1434] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.002s
12:14:40.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.458019 18407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae4e19d6d944f36af588d41dc8f2593" candidate_uuid: "a23113f6788a4602994404c467dee91e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95706152c43f41ab8b4c6037c07ea936"
12:14:40.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.464375 18345 leader_election.cc:304] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: a23113f6788a4602994404c467dee91e
12:14:40.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.465216 18997 raft_consensus.cc:2804] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:40.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.465546 18997 raft_consensus.cc:493] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:40.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.465862 18997 raft_consensus.cc:3060] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:40.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.465965 18703 leader_election.cc:304] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a23113f6788a4602994404c467dee91e; no voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936
12:14:40.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.466976 18993 raft_consensus.cc:2749] T 9ae4e19d6d944f36af588d41dc8f2593 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
12:14:40.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.468611 19003 ts_tablet_manager.cc:1434] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936: Time spent starting tablet: real 0.199s	user 0.004s	sys 0.002s
12:14:40.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.474435 18997 raft_consensus.cc:515] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.477404 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767e235fa4084d34a4e3b5d8f3c13bf6" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.477916 18625 raft_consensus.cc:3060] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.483907 18625 raft_consensus.cc:2468] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 1.
12:14:40.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.495849 18218 catalog_manager.cc:5697] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193). New cstate: current_term: 1 leader_uuid: "95706152c43f41ab8b4c6037c07ea936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: UNKNOWN } } }
12:14:40.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.499308 18345 leader_election.cc:304] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: 
12:14:40.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.500234 19027 raft_consensus.cc:2804] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election won for term 1
12:14:40.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.504026 19027 raft_consensus.cc:697] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [term 1 LEADER]: Becoming Leader. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Running, Role: LEADER
12:14:40.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.504878 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "767e235fa4084d34a4e3b5d8f3c13bf6" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e"
12:14:40.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.505425 18767 raft_consensus.cc:3060] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.504947 19027 consensus_queue.cc:237] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.505604 18997 leader_election.cc:290] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Requested vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.512902 18767 raft_consensus.cc:2468] T 767e235fa4084d34a4e3b5d8f3c13bf6 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 1.
12:14:40.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.522194 19027 raft_consensus.cc:493] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:40.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.522962 19027 raft_consensus.cc:515] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.525259 19027 leader_election.cc:290] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.526445 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36052c1a2c8c4d49ba87705834e15b86" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e" is_pre_election: true
12:14:40.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.526965 18625 raft_consensus.cc:2468] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 0.
12:14:40.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.527916 18345 leader_election.cc:304] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414328f38a134d6eaa3ce2c7212c587e, 95706152c43f41ab8b4c6037c07ea936; no voters: 
12:14:40.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.528522 19027 raft_consensus.cc:2804] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:40.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.528669 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36052c1a2c8c4d49ba87705834e15b86" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e" is_pre_election: true
12:14:40.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.528964 19027 raft_consensus.cc:493] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:40.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.529237 19027 raft_consensus.cc:3060] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 0 FOLLOWER]: Advancing to term 1
12:14:40.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.529251 18767 raft_consensus.cc:2468] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 0.
12:14:40.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.534827 19027 raft_consensus.cc:515] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.536402 19027 leader_election.cc:290] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Requested vote from peers 414328f38a134d6eaa3ce2c7212c587e (127.17.135.194:38601), a23113f6788a4602994404c467dee91e (127.17.135.195:35771)
12:14:40.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.535878 18218 catalog_manager.cc:5697] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193). New cstate: current_term: 1 leader_uuid: "95706152c43f41ab8b4c6037c07ea936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: UNKNOWN } } }
12:14:40.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.537077 18625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36052c1a2c8c4d49ba87705834e15b86" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414328f38a134d6eaa3ce2c7212c587e"
12:14:40.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.537593 18625 raft_consensus.cc:3060] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.541980 18767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36052c1a2c8c4d49ba87705834e15b86" candidate_uuid: "95706152c43f41ab8b4c6037c07ea936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23113f6788a4602994404c467dee91e"
12:14:40.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.542461 18767 raft_consensus.cc:3060] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 0 FOLLOWER]: Advancing to term 1
12:14:40.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.551687 18625 raft_consensus.cc:2468] T 36052c1a2c8c4d49ba87705834e15b86 P 414328f38a134d6eaa3ce2c7212c587e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 1.
12:14:40.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.552809 18767 raft_consensus.cc:2468] T 36052c1a2c8c4d49ba87705834e15b86 P a23113f6788a4602994404c467dee91e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95706152c43f41ab8b4c6037c07ea936 in term 1.
12:14:40.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.553727 18344 leader_election.cc:304] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95706152c43f41ab8b4c6037c07ea936, a23113f6788a4602994404c467dee91e; no voters: 
12:14:40.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.554986 19027 raft_consensus.cc:2804] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 1 FOLLOWER]: Leader election won for term 1
12:14:40.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.555532 19027 raft_consensus.cc:697] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [term 1 LEADER]: Becoming Leader. State: Replica: 95706152c43f41ab8b4c6037c07ea936, State: Running, Role: LEADER
12:14:40.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.556329 19027 consensus_queue.cc:237] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } }
12:14:40.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.565629 18218 catalog_manager.cc:5697] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193). New cstate: current_term: 1 leader_uuid: "95706152c43f41ab8b4c6037c07ea936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 } health_report { overall_health: UNKNOWN } } }
12:14:40.574 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.126:33897(127.16.194.126:33897)] disconnecting while in state READY
12:14:40.574 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.124:36205(127.16.194.124:36205)] disconnecting while in state READY
12:14:40.574 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.125:40961(127.16.194.125:40961)] disconnecting while in state READY
12:14:40.575 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.16.194.125:40961(127.16.194.125:40961)] handling channelInactive
12:14:40.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state READY due to: connection closed
12:14:40.576 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.16.194.124:36205(127.16.194.124:36205)] handling channelInactive
12:14:40.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state READY due to: connection closed
12:14:40.576 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:40.577 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
12:14:40.578 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:14:40.582 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.16.194.126:33897(127.16.194.126:33897)] handling channelInactive
12:14:40.582 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state READY due to: connection closed
12:14:40.582 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:14:40.583 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.254:37603(127.17.135.254:37603)] disconnecting while in state READY
12:14:40.583 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.252:38447(127.17.135.252:38447)] disconnecting while in state READY
12:14:40.583 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.253:43339(127.17.135.253:43339)] disconnecting while in state READY
12:14:40.583 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:40.583 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:40.583 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:40.583 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:40.584 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:40.585 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:14:40.585 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
12:14:40.586 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.587 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.587 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.587 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.587 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.587 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.588 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.588 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.588 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.588 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.588 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.588 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.588 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.589 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:40.588 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28860), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [15ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [21ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [75ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [112ms] refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [117ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [203ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1043ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1664ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2703ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1778444193(state=PENDING, result=null, callback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205), errback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205)))
12:14:40.589 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:40.589 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:14:40.589 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.589 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.589 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28860), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [15ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [21ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [75ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [112ms] refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [117ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [203ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1043ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1664ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2703ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1778444193(state=PENDING, result=null, callback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205), errback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28860), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [15ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [21ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [75ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [112ms] refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [117ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [203ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1043ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1664ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2703ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1778444193(state=PENDING, result=null, callback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205), errback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:40.590 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.590 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.590 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.590 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.590 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.590 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.597 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28860), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [15ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [21ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [75ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [112ms] refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [117ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [203ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1043ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1664ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2703ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1778444193(state=PENDING, result=null, callback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205), errback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28860), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [15ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [20ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [21ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [75ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [112ms] refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [117ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [203ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [541ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [542ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1040ms] refreshing cache from master, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1043ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1043ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1661ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1662ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1664ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2703ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [4040ms] refreshing cache from master, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [4042ms] too many traces: truncated at 100 traces, deferred=Deferred@1778444193(state=PENDING, result=null, callback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205), errback=(continuation of Deferred@797639767 after retry RPC after error@294439688) -> (continuation of Deferred@1176150231 after retry RPC after error@734689882) -> (continuation of Deferred@1553234632 after retry RPC after error@733425369) -> (continuation of Deferred@943210336 after retry RPC after error@1087933079) -> (continuation of Deferred@1063643774 after retry RPC after error@766954157) -> (continuation of Deferred@1418474308 after retry RPC after error@1342478192) -> (continuation of Deferred@1076011284 after retry RPC after error@1532688415) -> (continuation of Deferred@1861875235 after retry RPC after error@447890331) -> (continuation of Deferred@1330473944 after retry RPC after error@1130096686) -> (continuation of Deferred@1647462024 after retry RPC after error@1779728334) -> (continuation of Deferred@1319361279 after retry RPC after error@1378177437) -> (continuation of Deferred@584272727 after retry RPC after error@1802545868) -> (continuation of Deferred@995422591 after retry RPC after error@1124460081) -> (continuation of Deferred@2067039477 after retry RPC after error@368863125) -> (continuation of Deferred@163554140 after retry RPC after error@1701312564) -> (continuation of Deferred@984341313 after retry RPC after error@1277023054) -> (continuation of Deferred@944520402 after retry RPC after error@1647367607) -> (continuation of Deferred@103119715 after retry RPC after error@604004170) -> (continuation of Deferred@2104708532 after retry RPC after error@420131520) -> (continuation of Deferred@886652129 after retry RPC after error@310763327) -> (continuation of Deferred@1971072566 after retry RPC after error@959192811) -> (continuation of Deferred@1148130075 after retry RPC after error@2016362638) -> (continuation of Deferred@1815534627 after retry RPC after error@901008392) -> (continuation of Deferred@159348334 after retry RPC after error@190213375) -> (continuation of Deferred@1364950642 after retry RPC after error@1176026205)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:40.597 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:14:40.598 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
12:14:40.599 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:14:40.599 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:14:40.600 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:14:40.600 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:14:40.600 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:14:40.600 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:14:40.598 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:14:40.605 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.605 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.605 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:40.606 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:14:40.606 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.606 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:40.606 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.606 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.606 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.606 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.606 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.606 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:14:40.606 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.606 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
12:14:40.606 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.606 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.606 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.606 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:40.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:14:40.609 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:40.613 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:40.613 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:14:40.613 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:14:40.613 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:14:40.614 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:40.614 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:14:40.614 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
12:14:40.614 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:14:40.614 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:40.614 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
12:14:40.615 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:14:40.615 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:40.615 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:14:40.616 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:14:40.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:40.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.625 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.626 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.626 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.626 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.645 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.645 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.645 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.646 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.646 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.646 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.646 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.646 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.646 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.646 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:40.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:40.651 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:40.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:40.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:40.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:40.652 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:40.652 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:40.652 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:40.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:40.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:40.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:40.652 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:40.659 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:40.659 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:40.659 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:40.659 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:40.660 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:40.660 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:40.660 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:40.660 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:40.660 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:40.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:40.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:40.660 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:40.660 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:40.665 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.665 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.665 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.666 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.666 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.666 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.706 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.706 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.706 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.707 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.707 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.707 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.707 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.707 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.707 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.707 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.708 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.708 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.708 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.765 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.765 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.766 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.766 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.766 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.766 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.766 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.766 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.782644 19027 consensus_queue.cc:1048] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:40.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.812330 19035 consensus_queue.cc:1048] T 9ae4e19d6d944f36af588d41dc8f2593 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:14:40.835 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:14:40.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:40.852 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.853 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.853 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.856 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.856 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.856 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.857 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.857 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.857 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.857 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.894577 18993 consensus_queue.cc:1048] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95706152c43f41ab8b4c6037c07ea936" member_type: VOTER last_known_addr { host: "127.17.135.193" port: 45465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:40.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:40.921545 18993 consensus_queue.cc:1048] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:40.965 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:40.966 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:40.966 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:40.966 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.966 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.967 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:40.967 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.967 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.967 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:40.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.968 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:40.968 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:40.983 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:14:40.983 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:14:40.983 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:14:40.998 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:14:41.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:41.032145 19027 consensus_queue.cc:1048] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:41.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:41.046507 18997 consensus_queue.cc:1048] T 36052c1a2c8c4d49ba87705834e15b86 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:41.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:41.060642 18997 consensus_queue.cc:1048] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414328f38a134d6eaa3ce2c7212c587e" member_type: VOTER last_known_addr { host: "127.17.135.194" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:41.080 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:41.080 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:41.080 [DEBUG - pool-136-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:41.081 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.081 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.081 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.081 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.081 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.081 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.081 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.081 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.081 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.081 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:41.082 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29380), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [12ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [14ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [14ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [37ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [39ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [88ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [117ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [118ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [164ms] refreshing cache from master, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [164ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [165ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [166ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [166ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [562ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [682ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [682ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [683ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [683ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [742ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2682ms] too many traces: truncated at 100 traces, deferred=Deferred@1929230348(state=PENDING, result=null, callback=(continuation of Deferred@1719785803 after retry RPC after error@1959091991) -> (continuation of Deferred@880671029 after retry RPC after error@736041582) -> (continuation of Deferred@1140639199 after retry RPC after error@496961360) -> (continuation of Deferred@1190195591 after retry RPC after error@363831133) -> (continuation of Deferred@811102730 after retry RPC after error@1436047062) -> (continuation of Deferred@338028843 after retry RPC after error@2098846085) -> (continuation of Deferred@237120526 after retry RPC after error@429647354) -> (continuation of Deferred@575417171 after retry RPC after error@296356718) -> (continuation of Deferred@251074313 after retry RPC after error@1208325912) -> (continuation of Deferred@189807608 after retry RPC after error@1256239239) -> (continuation of Deferred@2082056589 after retry RPC after error@415259713) -> (continuation of Deferred@314915674 after retry RPC after error@1575933197) -> (continuation of Deferred@1821002492 after retry RPC after error@1983000952) -> (continuation of Deferred@1293343503 after retry RPC after error@1719351581) -> (continuation of Deferred@1486377604 after retry RPC after error@1061552414) -> (continuation of Deferred@1156807514 after retry RPC after error@2071920904) -> (continuation of Deferred@1634295953 after retry RPC after error@1856553811) -> (continuation of Deferred@836652151 after retry RPC after error@850033669) -> (continuation of Deferred@409861929 after retry RPC after error@821495084) -> (continuation of Deferred@1938381489 after retry RPC after error@312625809) -> (continuation of Deferred@1707174747 after retry RPC after error@1830276266) -> (continuation of Deferred@1416781675 after retry RPC after error@1417966006) -> (continuation of Deferred@988890062 after retry RPC after error@1775282854) -> (continuation of Deferred@790571504 after retry RPC after error@1491199076) -> (continuation of Deferred@1757291397 after retry RPC after error@81211822) -> (continuation of Deferred@1381095533 after retry RPC after error@88396935) -> (continuation of Deferred@478113185 after retry RPC after error@555251137), errback=(continuation of Deferred@1719785803 after retry RPC after error@1959091991) -> (continuation of Deferred@880671029 after retry RPC after error@736041582) -> (continuation of Deferred@1140639199 after retry RPC after error@496961360) -> (continuation of Deferred@1190195591 after retry RPC after error@363831133) -> (continuation of Deferred@811102730 after retry RPC after error@1436047062) -> (continuation of Deferred@338028843 after retry RPC after error@2098846085) -> (continuation of Deferred@237120526 after retry RPC after error@429647354) -> (continuation of Deferred@575417171 after retry RPC after error@296356718) -> (continuation of Deferred@251074313 after retry RPC after error@1208325912) -> (continuation of Deferred@189807608 after retry RPC after error@1256239239) -> (continuation of Deferred@2082056589 after retry RPC after error@415259713) -> (continuation of Deferred@314915674 after retry RPC after error@1575933197) -> (continuation of Deferred@1821002492 after retry RPC after error@1983000952) -> (continuation of Deferred@1293343503 after retry RPC after error@1719351581) -> (continuation of Deferred@1486377604 after retry RPC after error@1061552414) -> (continuation of Deferred@1156807514 after retry RPC after error@2071920904) -> (continuation of Deferred@1634295953 after retry RPC after error@1856553811) -> (continuation of Deferred@836652151 after retry RPC after error@850033669) -> (continuation of Deferred@409861929 after retry RPC after error@821495084) -> (continuation of Deferred@1938381489 after retry RPC after error@312625809) -> (continuation of Deferred@1707174747 after retry RPC after error@1830276266) -> (continuation of Deferred@1416781675 after retry RPC after error@1417966006) -> (continuation of Deferred@988890062 after retry RPC after error@1775282854) -> (continuation of Deferred@790571504 after retry RPC after error@1491199076) -> (continuation of Deferred@1757291397 after retry RPC after error@81211822) -> (continuation of Deferred@1381095533 after retry RPC after error@88396935) -> (continuation of Deferred@478113185 after retry RPC after error@555251137)))
12:14:41.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:41.081988 19027 consensus_queue.cc:1048] T 767e235fa4084d34a4e3b5d8f3c13bf6 P 95706152c43f41ab8b4c6037c07ea936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23113f6788a4602994404c467dee91e" member_type: VOTER last_known_addr { host: "127.17.135.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:14:41.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:41.265 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:41.266 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:41.266 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:41.266 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.266 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.266 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.267 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.267 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.267 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.268 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.268 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.268 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.268 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:41.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:41.428 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:41.428 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:41.428 [DEBUG - pool-138-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:41.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.429 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:41.429 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:41.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:41.430 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:41.430 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29702), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [23ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [24ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [53ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [56ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [72ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [114ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [114ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [223ms] refreshing cache from master, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [225ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [225ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [262ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [484ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [484ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [921ms] refreshing cache from master, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [922ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [922ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1941ms] refreshing cache from master, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1942ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1943ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2563ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [4321ms] refreshing cache from master, [4321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4322ms] too many traces: truncated at 100 traces, deferred=Deferred@1787054643(state=PENDING, result=null, callback=(continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288) -> (continuation of Deferred@874546324 after retry RPC after error@968872312) -> (continuation of Deferred@51194125 after retry RPC after error@1389310628) -> (continuation of Deferred@1660622925 after retry RPC after error@629682555), errback=(continuation of Deferred@1550128783 after retry RPC after error@1486383655) -> (continuation of Deferred@1456126506 after retry RPC after error@517449490) -> (continuation of Deferred@1794251561 after retry RPC after error@1906351362) -> (continuation of Deferred@1916297974 after retry RPC after error@1366598804) -> (continuation of Deferred@723900096 after retry RPC after error@1578636843) -> (continuation of Deferred@1862721740 after retry RPC after error@463649212) -> (continuation of Deferred@506785758 after retry RPC after error@203645) -> (continuation of Deferred@1482398513 after retry RPC after error@1455072991) -> (continuation of Deferred@1875503561 after retry RPC after error@1997135806) -> (continuation of Deferred@1930383485 after retry RPC after error@1887472797) -> (continuation of Deferred@1353164005 after retry RPC after error@1776969056) -> (continuation of Deferred@1617910936 after retry RPC after error@352309356) -> (continuation of Deferred@2039668378 after retry RPC after error@1130980781) -> (continuation of Deferred@1509452484 after retry RPC after error@862895399) -> (continuation of Deferred@1550308318 after retry RPC after error@1420530162) -> (continuation of Deferred@1310683113 after retry RPC after error@148796552) -> (continuation of Deferred@1782955886 after retry RPC after error@1659471829) -> (continuation of Deferred@1471990854 after retry RPC after error@750618637) -> (continuation of Deferred@1808071739 after retry RPC after error@1161632185) -> (continuation of Deferred@1951540132 after retry RPC after error@879702211) -> (continuation of Deferred@2022057809 after retry RPC after error@1432029481) -> (continuation of Deferred@821120805 after retry RPC after error@2111150288) -> (continuation of Deferred@874546324 after retry RPC after error@968872312) -> (continuation of Deferred@51194125 after retry RPC after error@1389310628) -> (continuation of Deferred@1660622925 after retry RPC after error@629682555)))
12:14:41.445 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:41.445 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:41.445 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:41.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.446 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:41.447 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.447 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.447 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:41.447 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.447 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.447 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:41.447 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:41.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:41.752 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:41.752 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:41.752 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:41.753 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:41.753 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:41.753 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:41.753 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:41.753 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:41.753 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:41.753 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:41.753 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:41.753 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:41.753 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:41.800 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:14:41.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:41.929 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:41.929 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:41.929 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:41.929 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:41.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:41.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:41.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:41.930 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:41.930 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:41.930 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:41.930 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:41.930 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:41.930 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:41.952 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:14:41.983 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:14:42.029 [INFO - flink-metrics-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:14:42.046 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:14:42.083 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:42.083 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:42.083 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:42.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.084 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.084 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.084 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.084 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.084 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.084 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.084 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.085 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:42.088 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:14:42.096 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:14:42.097 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:14:42.097 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:14:42.098 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:14:42.098 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:14:42.098 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:14:42.098 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:14:42.099 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:14:42.100 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:14:42.100 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:14:42.101 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:14:42.101 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:14:42.101 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:14:42.101 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:14:42.101 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:14:42.101 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:14:42.101 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:14:42.101 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:14:42.101 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:14:42.102 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:14:42.102 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:14:42.102 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:14:42.102 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:14:42.102 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:14:42.103 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_367f6f54551bbba7b65bae62fb2051dd/blobStorage
12:14:42.104 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:40975 - max concurrent requests: 50 - max backlog: 1000
12:14:42.105 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_367f6f54551bbba7b65bae62fb2051dd/blobStorage
12:14:42.105 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_367f6f54551bbba7b65bae62fb2051dd/blobStorage
12:14:42.106 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:14:42.107 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: ced9c8a0-7afc-4165-a679-8d909c5af9eb
12:14:42.108 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:14:42.109 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-f5ea2b96-a4c9-4ae5-ac4d-ad23abb9a8e4
12:14:42.110 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-740413a8-b58f-447a-a804-3ea47fc43314
12:14:42.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:42.172 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:14:42.173 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:14:42.173 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:14:42.173 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:14:42.174 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:14:42.175 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_12 .
12:14:42.180 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
12:14:42.181 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-7bb8dd6e-c367-4ac0-b327-781a8583ce21
12:14:42.181 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:14:42.182 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:14:42.191 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:14:42.191 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:14:42.200 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:42.200 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:42.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.201 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.201 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.201 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.201 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.201 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:42.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.201 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.201 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:42.207 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:37987
12:14:42.207 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:14:42.214 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:37987 was granted leadership with leaderSessionID=a7456bbb-becd-493a-af86-cf0938d06e64
12:14:42.215 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:37987 , session=a7456bbb-becd-493a-af86-cf0938d06e64
12:14:42.216 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:14:42.217 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:14:42.217 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:14:42.217 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 03cd19b7-835c-4e2c-883d-ff9da8ffa3e9. Creating new DispatcherLeaderProcess.
12:14:42.217 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:14:42.217 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:14:42.218 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:14:42.218 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:14:42.219 [INFO - pool-173-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 0131a06b-d305-4bf1-b816-63ecef6c33be.
12:14:42.220 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_13 .
12:14:42.221 [INFO - pool-173-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_14 .
12:14:42.225 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
12:14:42.225 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:14:42.226 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:14:42.226 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:14:42.226 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:14:42.226 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_14 , session=0131a06b-d305-4bf1-b816-63ecef6c33be
12:14:42.229 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(b81663ecef6c33be0131a06bd3054bf1).
12:14:42.241 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_13 , session=03cd19b7-835c-4e2c-883d-ff9da8ffa3e9
12:14:42.253 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:14:42.259 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.260 [INFO - flink-pekko.actor.default-dispatcher-4] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.260 [INFO - flink-pekko.actor.default-dispatcher-4] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-5184ffe83187ccec3ebfd9d613debdde'.
12:14:42.260 [INFO - flink-pekko.actor.default-dispatcher-7] (ResourceManager.java:1080) Registering TaskManager with ResourceID ced9c8a0-7afc-4165-a679-8d909c5af9eb (pekko://flink/user/rpc/taskmanager_12) at ResourceManager
12:14:42.260 [INFO - mini-cluster-io-thread-4] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 5184ffe83187ccec3ebfd9d613debdde was granted leadership with leader id 7d9268bb-5be5-4078-921c-5cabe9b5ea35. Creating new JobMasterServiceProcess.
12:14:42.261 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_14 under registration id b4499cb96b4170b1934e030fd89bae66.
12:14:42.261 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:344) Registering task executor ced9c8a0-7afc-4165-a679-8d909c5af9eb under b4499cb96b4170b1934e030fd89bae66 at the slot manager.
12:14:42.262 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_15 .
12:14:42.266 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.272 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.272 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 235edac217b8d0dd9e42748196a1ed51 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.272 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.272 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:14:42.273 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:14:42.273 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8b7e6e6
12:14:42.274 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:42.274 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:14:42.275 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:14:42.275 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@7f73196d for Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde).
12:14:42.275 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_15 , session=7d9268bb-5be5-4078-921c-5cabe9b5ea35
12:14:42.276 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (5184ffe83187ccec3ebfd9d613debdde) under job master id 921c5cabe9b5ea357d9268bb5be54078.
12:14:42.277 [INFO - flink-pekko.actor.default-dispatcher-6] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:42.278 [DEBUG - flink-pekko.actor.default-dispatcher-6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.279 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:14:42.279 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state CREATED to RUNNING.
12:14:42.280 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:14:42.280 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:42.280 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:14:42.281 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:14:42.281 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:14:42.282 [INFO - flink-pekko.actor.default-dispatcher-6] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_14(b81663ecef6c33be0131a06bd3054bf1)
12:14:42.283 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:14:42.284 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:390) Registering job manager 921c5cabe9b5ea357d9268bb5be54078@pekko://flink/user/rpc/jobmanager_15 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.289 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:1015) Registered job manager 921c5cabe9b5ea357d9268bb5be54078@pekko://flink/user/rpc/jobmanager_15 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.292 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:42.292 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:42.292 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:42.293 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.293 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.293 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:42.293 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.293 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.293 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:42.294 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:42.294 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:42.296 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.16.194.126:33897(127.16.194.126:33897)] Successfully connected to peer
12:14:42.296 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:42.303 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.126
12:14:42.303 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b81663ecef6c33be0131a06bd3054bf1.
12:14:42.304 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:42.310 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:42.310 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.16.194.124:36205(127.16.194.124:36205)] Successfully connected to peer
12:14:42.318 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.321 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.16.194.125:40961(127.16.194.125:40961)] Successfully connected to peer
12:14:42.323 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x54e11648, L:/127.0.0.1:43210 - R:/127.16.194.126:33897] using SASL/PLAIN
12:14:42.329 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 5184ffe83187ccec3ebfd9d613debdde
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager ced9c8a0-7afc-4165-a679-8d909c5af9eb
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:14:42.330 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 65a7f98cdf28aed37ee86b96f022fa7b from ced9c8a0-7afc-4165-a679-8d909c5af9eb for job 5184ffe83187ccec3ebfd9d613debdde with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.330 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.124
12:14:42.330 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 662c4bfa88ebb225fdaa868646c1528c from ced9c8a0-7afc-4165-a679-8d909c5af9eb for job 5184ffe83187ccec3ebfd9d613debdde with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.331 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 71b57ea17b002970ac3f421ada230e68 from ced9c8a0-7afc-4165-a679-8d909c5af9eb for job 5184ffe83187ccec3ebfd9d613debdde with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.331 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 0a5a435094a34c4d26773a7961a9735f from ced9c8a0-7afc-4165-a679-8d909c5af9eb for job 5184ffe83187ccec3ebfd9d613debdde with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.332 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 65a7f98cdf28aed37ee86b96f022fa7b for job 5184ffe83187ccec3ebfd9d613debdde from resource manager with leader id b81663ecef6c33be0131a06bd3054bf1.
12:14:42.332 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 65a7f98cdf28aed37ee86b96f022fa7b with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:42.337 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:42.338 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.341 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.125
12:14:42.344 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x85d544e1, L:/127.0.0.1:52326 - R:/127.16.194.124:36205] using SASL/PLAIN
12:14:42.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.348 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=68), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [47ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: OK, deferred=null) after lookup
12:14:42.349 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 5184ffe83187ccec3ebfd9d613debdde for job leader monitoring.
12:14:42.349 [INFO - mini-cluster-io-thread-4] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_15 with leader id 7d9268bb-5be5-4078-921c-5cabe9b5ea35.
12:14:42.349 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 662c4bfa88ebb225fdaa868646c1528c for job 5184ffe83187ccec3ebfd9d613debdde from resource manager with leader id b81663ecef6c33be0131a06bd3054bf1.
12:14:42.349 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 662c4bfa88ebb225fdaa868646c1528c with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.350 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 71b57ea17b002970ac3f421ada230e68 for job 5184ffe83187ccec3ebfd9d613debdde from resource manager with leader id b81663ecef6c33be0131a06bd3054bf1.
12:14:42.350 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 71b57ea17b002970ac3f421ada230e68 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.351 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 0a5a435094a34c4d26773a7961a9735f for job 5184ffe83187ccec3ebfd9d613debdde from resource manager with leader id b81663ecef6c33be0131a06bd3054bf1.
12:14:42.351 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 0a5a435094a34c4d26773a7961a9735f with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:14:42.351 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:14:42.351 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.353 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_15 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.353 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.353 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.354 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:14:42.354 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 662c4bfa88ebb225fdaa868646c1528c
12:14:42.354 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:42.355 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 662c4bfa88ebb225fdaa868646c1528c.
12:14:42.356 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.356 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:14:42.356 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 5184ffe83187ccec3ebfd9d613debdde
12:14:42.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:14:42.358 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:42.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 71b57ea17b002970ac3f421ada230e68
12:14:42.363 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 662c4bfa88ebb225fdaa868646c1528c.
12:14:42.364 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:14:42.364 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6ca88a65, L:/127.0.0.1:57956 - R:/127.16.194.125:40961] using SASL/PLAIN
12:14:42.364 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 0a5a435094a34c4d26773a7961a9735f
12:14:42.366 [DEBUG - main] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:42.367 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:42.368 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:42.370 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:42.371 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.371 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.372 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.372 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.390 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:42.390 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:42.394 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:42.398 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.401 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x4ce4a564, L:/127.0.0.1:43224 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:42.404 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.404 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:14:42.404 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 65a7f98cdf28aed37ee86b96f022fa7b
12:14:42.405 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:42.405 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:14:42.407 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 71b57ea17b002970ac3f421ada230e68.
12:14:42.408 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.408 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:14:42.409 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:14:42.410 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6a82403c
12:14:42.410 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:42.417 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd20cbc87, L:/127.0.0.1:48080 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:42.417 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:14:42.418 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:14:42.419 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0a5a435094a34c4d26773a7961a9735f.
12:14:42.420 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 0a5a435094a34c4d26773a7961a9735f.
12:14:42.422 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x470d4ffe, L:/127.0.0.1:34206 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:42.423 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.423 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=108), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [68ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:42.425 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:14:42.426 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:14:42.427 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.428 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:14:42.429 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:42.429 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:42.429 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:42.429 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7003da1b
12:14:42.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.429 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:42.430 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:14:42.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.430 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:14:42.430 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.430 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.430 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.431 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:42.431 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:14:42.433 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 662c4bfa88ebb225fdaa868646c1528c.
12:14:42.433 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:14:42.433 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 0a5a435094a34c4d26773a7961a9735f.
12:14:42.433 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 65a7f98cdf28aed37ee86b96f022fa7b.
12:14:42.433 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 65a7f98cdf28aed37ee86b96f022fa7b.
12:14:42.434 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2bc1eeeb
12:14:42.434 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id 65a7f98cdf28aed37ee86b96f022fa7b.
12:14:42.437 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.437 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:14:42.437 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.437 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.437 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@713dc181
12:14:42.437 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:42.438 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.438 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:14:42.438 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=10), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.17.135.252:38447, [10ms] Sub RPC GetTableLocations: received response from server master-127.17.135.252:38447: OK, deferred=null)) after lookup
12:14:42.438 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:14:42.438 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] connecting to peer
12:14:42.438 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:14:42.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:14:42.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:14:42.441 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bb01231
12:14:42.441 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:42.441 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:14:42.441 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:14:42.441 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5250bb35
12:14:42.441 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:14:42.442 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:42.443 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.444 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f48ae48
12:14:42.447 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.457 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6c6bb281
12:14:42.459 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.472 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] Successfully connected to peer
12:14:42.480 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:42.481 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:42.486 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:42.488 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:42.497 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:42.502 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.507 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xda594e43, L:/127.0.0.1:34220 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:42.520 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.527 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x0f966a5a, L:/127.0.0.1:50914 - R:/127.17.135.194:38601] using TOKEN/null
12:14:42.528 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:14:42.528 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:42.529 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:42.530 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:42.531 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:42.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.531 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:42.532 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.532 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.532 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.532 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.532 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.532 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.532 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:42.533 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:42.534 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:42.536 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:42.538 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:42.543 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.544 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:42.544 [DEBUG - main] (Connection.java:748) [peer a23113f6788a4602994404c467dee91e(127.17.135.195:35771)] connecting to peer
12:14:42.545 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:42.546 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.549 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0bb1187c, L:/127.0.0.1:43238 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:42.550 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:42.552 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.555 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xadfd4504, L:/127.0.0.1:34226 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:42.557 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:42.561 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:42.563 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:42.565 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:42.568 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:42.569 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:42.569 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.571 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.573 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x01d4d2dc, L:/127.0.0.1:43248 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:42.573 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:42.582 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:42.583 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x140944cc, L:/127.0.0.1:48088 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:42.585 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:42.587 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.588 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:42.589 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:42.590 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc64764fe, L:/127.0.0.1:34234 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:42.591 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.591 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=131), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [29ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:42.598 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:42.598 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.598 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.604 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xca3be160, L:/127.0.0.1:48100 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:42.608 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.609 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=165), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [110ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:42.609 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.611 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.614 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.614 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:42.614 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x353a66e7, L:/127.0.0.1:43258 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:42.614 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f889c49
12:14:42.615 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:14:42.616 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.17.135.253:43339(127.17.135.253:43339)] Successfully connected to peer
12:14:42.616 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:14:42.616 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:14:42.617 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:14:42.619 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.253
12:14:42.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:42.620 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.620 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@32ca4297
12:14:42.623 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:14:42.623 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:14:42.628 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.17.135.254:37603(127.17.135.254:37603)] Successfully connected to peer
12:14:42.631 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.645 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.254
12:14:42.646 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaec0c4b3, L:/127.0.0.1:34238 - R:/127.17.135.253:43339] using SASL/PLAIN
12:14:42.649 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.654 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.17.135.252:38447(127.17.135.252:38447)] Successfully connected to peer
12:14:42.655 [DEBUG - kudu-nio-4] (Connection.java:757) [peer a23113f6788a4602994404c467dee91e(127.17.135.195:35771)] Successfully connected to peer
12:14:42.656 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x041bf533, L:/127.0.0.1:48108 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:42.656 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.17.135.252
12:14:42.663 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.664 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.664 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.664 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: OK, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [110ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: OK, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:42.666 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:14:42.667 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4187710308828f9bd709c35fe7481777851c540a95698b6cf70c5df4efbabf46'}]
12:14:42.667 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.669 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.670 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x67e81fbd, L:/127.0.0.1:48114 - R:/127.17.135.252:38447] using SASL/PLAIN
12:14:42.671 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:42.671 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:42.671 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:42.672 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.672 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.672 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:42.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:42.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:42.673 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:42.673 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.674 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@49b57719
12:14:42.674 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:14:42.674 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=227), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [156ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: OK, [178ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: OK, deferred=null) after lookup
12:14:42.675 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x17e6bcdd, L:/127.0.0.1:43274 - R:/127.17.135.254:37603] using SASL/PLAIN
12:14:42.678 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.681 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:42.681 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10596068
12:14:42.684 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.688 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x61085e6c, L:/127.0.0.1:50506 - R:/127.17.135.195:35771] using TOKEN/null
12:14:42.698 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.698 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:42.698 [DEBUG - main] (Connection.java:748) [peer 95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)] connecting to peer
12:14:42.725 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:14:42.725 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a178080ac6918c54938f46cf8317a096785612e38f41ea838b784b8f43182b46'}]
12:14:42.727 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.732 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:42.733 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:42.748 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:14:42.761 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:14:42.771 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:42.784 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:42.785 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:42.789 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:14:42.792 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:14:42.793 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:14:42.793 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:14:42.793 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:14:42.800 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)] Successfully connected to peer
12:14:42.828 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:14:42.836 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:42.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:42.846 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:42.850 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:14:42.851 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:14:42.852 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='08412424e70126a1c82db76ccce00f41117ba87856d19f804cf8ade08a380d9a'}]
12:14:42.854 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.855 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3a4d766a4fbedb06343faab4deeda28ef7dd36bdcd4a19cbde9a279a81ad8dc8'}]
12:14:42.856 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.864 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:42.865 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:42.883 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:42.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512882885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:42.895 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:14:42.896 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.897 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:42.900 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:42.905 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:42.914 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:42.914 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.917 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x055f846b, L:/127.0.0.1:52428 - R:/127.17.135.193:45465] using TOKEN/null
12:14:42.924 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:42.929 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2b014cb4, L:/127.0.0.1:41108 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:42.938 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc8207f77, L:/127.0.0.1:41102 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:42.948 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:42.949 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:42.950 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:42.959 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=386b64c8ec0c469ebd53d12eadb01231, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.960 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [a178080ac6918c54938f46cf8317a096785612e38f41ea838b784b8f43182b46]
12:14:42.960 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 5184ffe83187ccec3ebfd9d613debdde (4946 bytes, checkpointDuration=75 ms, finalizationTime=0 ms).
12:14:42.961 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a178080ac6918c54938f46cf8317a096785612e38f41ea838b784b8f43182b46]
12:14:42.961 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:42.961 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:42.962 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:42.963 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:42.964 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.964 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:42.965 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.965 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a178080ac6918c54938f46cf8317a096785612e38f41ea838b784b8f43182b46 finished by subtask 2; deferring removal (restored in pending)
12:14:42.965 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:14:42.965 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split a178080ac6918c54938f46cf8317a096785612e38f41ea838b784b8f43182b46 from pending
12:14:42.965 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
12:14:42.965 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4187710308828f9bd709c35fe7481777851c540a95698b6cf70c5df4efbabf46]
12:14:42.966 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c59148e9c24a65de7a355b3d9836fb09dc59417b6cde752bfd6cb9476964c6e3'}]
12:14:42.967 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.969 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:42.969 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:14:42.971 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.971 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:42.972 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4187710308828f9bd709c35fe7481777851c540a95698b6cf70c5df4efbabf46]
12:14:42.974 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4187710308828f9bd709c35fe7481777851c540a95698b6cf70c5df4efbabf46 finished by subtask 1; deferring removal (restored in pending)
12:14:42.978 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:42.978 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:42.979 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:42.979 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0bad1cb1c14721d6af26a85ff9c875c42d8f4da01d602418cdefff00f6649dac'}]
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.983 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.984 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.984 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.984 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.985 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:42.990 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.990 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.992 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.992 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:42.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:42.993 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:42.996 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:42.997 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:42.998 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:14:43.031 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:43.043 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.043 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:43.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.061 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.069 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.070 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.070 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:43.072 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe0dba5e7, L:/127.0.0.1:41116 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:43.085 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:43.085 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:43.085 [DEBUG - pool-134-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:43.086 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.086 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.086 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.086 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.086 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.086 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:43.087 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x31da9f15, L:/127.0.0.1:41132 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:43.101 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.102 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [08412424e70126a1c82db76ccce00f41117ba87856d19f804cf8ade08a380d9a]
12:14:43.102 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [08412424e70126a1c82db76ccce00f41117ba87856d19f804cf8ade08a380d9a]
12:14:43.103 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:43.103 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:43.104 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 08412424e70126a1c82db76ccce00f41117ba87856d19f804cf8ade08a380d9a finished by subtask 0; deferring removal (restored in pending)
12:14:43.104 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:43.105 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=18e98bc7615e4665a6e500c1cab31dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.105 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:43.105 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [3a4d766a4fbedb06343faab4deeda28ef7dd36bdcd4a19cbde9a279a81ad8dc8]
12:14:43.105 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:14:43.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3a4d766a4fbedb06343faab4deeda28ef7dd36bdcd4a19cbde9a279a81ad8dc8]
12:14:43.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:14:43.113 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:14:43.113 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:43.115 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:43.116 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3a4d766a4fbedb06343faab4deeda28ef7dd36bdcd4a19cbde9a279a81ad8dc8 finished by subtask 3; deferring removal (restored in pending)
12:14:43.116 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.117 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.117 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.117 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:43.126 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.126 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.126 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.127 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.130 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.130 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.130 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.130 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.130 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.130 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.138 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:43.143 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.144 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.168 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:14:43.170 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:43.171 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:43.179 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.179 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.180 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.181 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:43.182 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:43.184 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.184 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.184 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.185 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.185 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.185 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.185 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.185 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.186 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.186 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.186 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.186 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.186 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.187 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.187 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.187 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.188 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.189 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.189 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.189 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.194 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:43.195 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:14:43.195 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.195 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.196 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.197 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:43.197 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.198 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.199 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.199 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.203 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:43.204 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.204 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.208 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:43.216 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.218 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x612180b5, L:/127.0.0.1:41134 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:43.219 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.221 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1e9b3251, L:/127.0.0.1:41148 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:43.237 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.237 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [0bad1cb1c14721d6af26a85ff9c875c42d8f4da01d602418cdefff00f6649dac]
12:14:43.237 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0bad1cb1c14721d6af26a85ff9c875c42d8f4da01d602418cdefff00f6649dac]
12:14:43.238 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:14:43.238 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:14:43.240 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:43.241 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0bad1cb1c14721d6af26a85ff9c875c42d8f4da01d602418cdefff00f6649dac finished by subtask 1; deferring removal (restored in pending)
12:14:43.242 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:43.248 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268765814784001) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.249 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [c59148e9c24a65de7a355b3d9836fb09dc59417b6cde752bfd6cb9476964c6e3]
12:14:43.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c59148e9c24a65de7a355b3d9836fb09dc59417b6cde752bfd6cb9476964c6e3]
12:14:43.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:14:43.249 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:14:43.250 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:43.250 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c59148e9c24a65de7a355b3d9836fb09dc59417b6cde752bfd6cb9476964c6e3 finished by subtask 2; deferring removal (restored in pending)
12:14:43.250 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:43.261 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.261 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.267 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.267 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.279 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.279 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.287 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.288 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.297 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.297 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.305 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.306 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:43.348 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.348 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.348 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.348 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:14:43.355 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:43.355 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:43.356 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:43.356 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:14:43.371 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:14:43.372 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:14:43.372 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
12:14:43.373 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:14:43.379 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
12:14:43.380 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
12:14:43.380 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:14:43.380 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
12:14:43.381 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
12:14:43.381 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:14:43.381 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
12:14:43.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.381 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:43.382 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:43.382 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:43.382 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:43.382 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:43.382 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:43.383 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.383 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:14:43.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.383 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.383 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.383 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.384 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.384 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:14:43.384 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.384 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:43.385 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
12:14:43.385 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:14:43.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512883385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:43.385 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
12:14:43.386 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
12:14:43.386 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:14:43.386 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:43.387 [INFO - Thread-38] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:14:43.387 [DEBUG - Thread-38] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:14:43.387 [DEBUG - Thread-38] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:14:43.387 [DEBUG - Thread-38] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:14:43.387 [DEBUG - Thread-38] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:43.388 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=4, operationSize=253, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@68bd314b, flushNotification=Deferred@1896451381(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:14:43.388 [INFO - Thread-38] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:14:43.389 [INFO - Thread-38] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:14:43.389 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=8, operationSize=505, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@444ffbee, flushNotification=Deferred@1338217662(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:14:43.390 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] connecting to peer
12:14:43.392 [DEBUG - Thread-38] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:43.392 [INFO - Thread-38] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:43.392 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:14:43.393 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:14:43.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
12:14:43.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
12:14:43.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@277e88ad
12:14:43.395 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:43.396 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.396 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.396 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:43.389 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] connecting to peer
12:14:43.402 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.402 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.402 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:14:43.403 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:14:43.403 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
12:14:43.403 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
12:14:43.404 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:14:43.404 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:14:43.404 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20ddecfc
12:14:43.404 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:43.404 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:43.404 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:14:43.406 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:14:43.406 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:14:43.407 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
12:14:43.407 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:14:43.407 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
12:14:43.408 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2f8c3397
12:14:43.408 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:43.408 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:43.408 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:14:43.408 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:14:43.410 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.410 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.415 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.415 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.417 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b668b04
12:14:43.419 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:43.420 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] Successfully connected to peer
12:14:43.421 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.421 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.424 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7058862c
12:14:43.426 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:43.432 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@659cef15
12:14:43.436 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:43.436 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:43.436 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:43.436 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:43.436 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:43.439 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
12:14:43.439 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
12:14:43.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@235078ac
12:14:43.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:43.440 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:14:43.441 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:14:43.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:43.440752 17549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.194.67:34965, user_credentials={real_user=slave}} blocked reactor thread for 65846.5us
12:14:43.441 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:14:43.448 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.450 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@72baa1c
12:14:43.452 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe7eae664, L:/127.0.0.1:50930 - R:/127.17.135.194:38601] using TOKEN/null
12:14:43.463 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.465 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:43.478 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.480 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.480 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.481 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:43.481 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:43.481 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:43.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:43.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.482 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.482 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:43.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:43.483 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:43.492 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.492 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.500 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.500 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.513 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.513 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.524 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.524 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.541 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:43.541 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:43.541 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:43.542 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:43.542 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:43.542 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:43.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:43.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:43.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:43.543 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:43.543 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:43.543 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:43.543 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:43.545 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.545 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.546 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] Successfully connected to peer
12:14:43.579 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:43.582 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.590 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.590 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x6669ebeb, L:/127.0.0.1:50940 - R:/127.17.135.194:38601] using TOKEN/null
12:14:43.591 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.591 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.591 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.594 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.595 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.602 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.604 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.604 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.610 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.610 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.610 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.611 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.615 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.616 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.618 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.618 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.618 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.620 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:43.632 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.632 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.638 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.638 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.638 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.639 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:43.643 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.643 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.643 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.643 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.644 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.644 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.650 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.653 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.655 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.659 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.659 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.661 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.661 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.662 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.663 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.665 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:43.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.670 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:43.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.678 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.687 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.687 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.687 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.687 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:43.699 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:43.733 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.743 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.745 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.745 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.748 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.748 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.748 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:43.753 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.753 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.753 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.753 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.770 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 5184ffe83187ccec3ebfd9d613debdde (4277 bytes, checkpointDuration=384 ms, finalizationTime=1 ms).
12:14:43.772 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:14:43.772 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.772 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 08412424e70126a1c82db76ccce00f41117ba87856d19f804cf8ade08a380d9a from pending
12:14:43.773 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 3a4d766a4fbedb06343faab4deeda28ef7dd36bdcd4a19cbde9a279a81ad8dc8 from pending
12:14:43.773 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 4187710308828f9bd709c35fe7481777851c540a95698b6cf70c5df4efbabf46 from pending
12:14:43.773 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 0bad1cb1c14721d6af26a85ff9c875c42d8f4da01d602418cdefff00f6649dac from pending
12:14:43.773 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split c59148e9c24a65de7a355b3d9836fb09dc59417b6cde752bfd6cb9476964c6e3 from pending
12:14:43.773 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 5 finished splits from enumerator state
12:14:43.773 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.773 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.773 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.778 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.779 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.779 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.785 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.786 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.791 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.791 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:43.803 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.803 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.803 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:43.808 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.808 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:43.813 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.813 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:43.817 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:43.820 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:43.832 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:43.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.834 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.835 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:43.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:43.839 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.845 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.848 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:43.849 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:43.849 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:43.849 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.849 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.849 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.849 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.855 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.856 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.857 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.858 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.862 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:43.869 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 558f97b6f817406587f99c961107450b
12:14:43.873 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.873 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.873 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.873 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.873 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:43.873 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:43.873 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:43.873 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:43.874 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:43.874 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:43.874 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:43.874 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.194.124:36205, [3ms] Sub RPC GetTableLocations: received response from server master-127.16.194.124:36205: OK, deferred=null)) after lookup
12:14:43.878 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.879 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.881 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.881 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.881 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512883885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:43.892 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.893 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.893 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.893 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.893 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.893 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:43.894 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:43.895 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.897 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.898 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.898 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:43.899 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 5184ffe83187ccec3ebfd9d613debdde (964 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:14:43.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.903 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:14:43.913 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.913 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.913 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.913 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.914 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.914 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.914 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.914 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.916 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.916 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0b11d3194e5543248721bee067c8f278 for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:43.918 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.919 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:43.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.922 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.922 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.922 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.922 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.923 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.923 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.938 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.938 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=386b64c8ec0c469ebd53d12eadb01231, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:43.938 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.938 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 386b64c8ec0c469ebd53d12eadb01231 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:43.939 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.939 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.939 [DEBUG - main] (Connection.java:748) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] connecting to peer
12:14:43.939 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.939 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.939 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.939 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.939 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.939 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.940 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.940 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.940 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.940 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.957 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.958 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.958 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.958 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.959 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.959 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.959 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.959 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.960 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.960 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.960 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.960 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.962 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.962 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.963 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.963 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.963 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.963 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.963 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.963 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.963 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.964 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.964 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.964 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.964 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.975 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:43.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:43.979 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.979 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:43.979 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:43.979 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:43.980 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:43.980 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:43.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:43.981 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.981 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.981 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:43.981 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:43.981 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:43.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:43.981 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:43.991 [DEBUG - kudu-nio-4] (Connection.java:757) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] Successfully connected to peer
12:14:43.999 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.000 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.000 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.000 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.000 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.000 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.001 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.001 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.001 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.013 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.015 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.019 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.019 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.019 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.019 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.019 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.020 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.020 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.020 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.020 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.020 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.020 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.020 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.020 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.020 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.020 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.020 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.021 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.021 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.021 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.021 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.021 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.021 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.021 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.021 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.021 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.022 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.022 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.022 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.023 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.023 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.023 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.024 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.028 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.031 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.038 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x9168a27a, L:/127.0.0.1:41312 - R:/127.16.194.65:46145] using TOKEN/null
12:14:44.042 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.043 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.059 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.059 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.059 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.060 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.060 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.060 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.061 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.061 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.061 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.061 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.061 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.061 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.062 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.062 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.062 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.062 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.062 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.062 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.062 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.066 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.066 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4f7abeeb47504b5988bb5e1c49541acf for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:44.068 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.069 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.069 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.069 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.073 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.073 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.073 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.073 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.078 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=18e98bc7615e4665a6e500c1cab31dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.078 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.079 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.079 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.079 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.080 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.080 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.080 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.080 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.080 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.080 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.081 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.081 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.081 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.082 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.082 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.082 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.082 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.082 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.082 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.082 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.084 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.078 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 18e98bc7615e4665a6e500c1cab31dda for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:44.088 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.088 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.088 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.088 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.097 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.097 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a0e07e3365584bb38520a776f55ad0d2 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:44.098 [DEBUG - main] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.118 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.120 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.120 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.120 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.120 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.124 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.125 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.125 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.125 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.133 [DEBUG - kudu-nio-5] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.138 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.139 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.139 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.139 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.139 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.139 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.139 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.139 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.139 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.139 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.139 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.140 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.140 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.140 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.140 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.140 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.141 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.141 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.141 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.140 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.142 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.142 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.142 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.142 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.142 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.142 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.142 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.142 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.142 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.143 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.143 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.157 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.163 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.179 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.180 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.180 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.181 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.181 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.181 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.181 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.181 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.181 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.183 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.183 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.183 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.184 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.199 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.200 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.200 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.201 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.201 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.201 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.201 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.201 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.201 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.201 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.201 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.201 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.202 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.202 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.202 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.203 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.203 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.203 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.203 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.203 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.203 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.204 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.204 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.204 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.204 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.204 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.204 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.204 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.204 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.204 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.205 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.209 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.212 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xa6ed053d, L:/127.0.0.1:41160 - R:/127.16.194.67:34965] using TOKEN/null
12:14:44.222 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.222 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 74735e91682e470180aaef67e499fada for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:44.229 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01a8562a1d6c431db04d9d4947215e7b for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:44.229 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 2e28ef28002144c494838792109461cd for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:44.229 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:44.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:44.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 9ae4e19d6d944f36af588d41dc8f2593 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:44.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 36052c1a2c8c4d49ba87705834e15b86 for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:44.230 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=01a8562a1d6c431db04d9d4947215e7b@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=2e28ef28002144c494838792109461cd@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=767e235fa4084d34a4e3b5d8f3c13bf6@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)[L],95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465),a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=9ae4e19d6d944f36af588d41dc8f2593@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=36052c1a2c8c4d49ba87705834e15b86@[414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601),95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)[L],a23113f6788a4602994404c467dee91e(127.17.135.195:35771)]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:44.230 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.17.135.252:38447, [6ms] Sub RPC GetTableLocations: received response from server master-127.17.135.252:38447: OK, deferred=null)) after lookup
12:14:44.238 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.239 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.239 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.239 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:44.239 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.239 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.239 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.240 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.241 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.247 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.248 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.248 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.251 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.251 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.251 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.252 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.252 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.252 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.255 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.255 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:44.258 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.259 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.259 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.260 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.260 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.260 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.260 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.260 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.260 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.260 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:44.261 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:44.261 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:44.261 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.261 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.261 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.261 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.261 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.261 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.261 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.261 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.261 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.261 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:44.262 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.262 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:44.270 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.270 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:44.281 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.282 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:44.294 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.294 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:44.298 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:44.302 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.302 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.302 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.303 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.304 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.304 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:44.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:44.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.304 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:44.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.304 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.304 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:44.304 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.306 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.306 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 0b11d3194e5543248721bee067c8f278 for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:44.309 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e1d9d5a606980d62719dc611004df9b02f92755580bea2f69848a07e2e4e68ec'}]
12:14:44.310 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e0046d73943bbede2b11dae3af8b88ce605b68127410754be707d8bc1b3bbbbe'}]
12:14:44.311 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.311 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:14:44.311 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.311 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='0122518a7054013ae7f7ae42cb96d02a5ab62b779e7293d1b22d877f9ed34047'}]
12:14:44.311 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299996, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:44.313 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='df8756eaedd1149d5877fc5c9a0f0bb4253524632cc4e4713082bd7e5f1b240a'}]
12:14:44.313 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=386b64c8ec0c469ebd53d12eadb01231, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.313 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 386b64c8ec0c469ebd53d12eadb01231 for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:44.312 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:14:44.314 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299996, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:44.318 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.318 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.319 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.319 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.319 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.319 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.319 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.319 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.319 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.320 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.321 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.322 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:14:44.322 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299996, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:44.323 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.323 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.323 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.323 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.324 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.324 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:14:44.324 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.324 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.324 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.324 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299996, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:44.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.325 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.333 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.337 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.338 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 4f7abeeb47504b5988bb5e1c49541acf for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:44.349 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=18e98bc7615e4665a6e500c1cab31dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.349 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 18e98bc7615e4665a6e500c1cab31dda for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:44.354 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.357 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.359 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.359 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet a0e07e3365584bb38520a776f55ad0d2 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:44.359 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.365 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.366 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 74735e91682e470180aaef67e499fada for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:44.367 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.379 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 4 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=01a8562a1d6c431db04d9d4947215e7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.380 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 01a8562a1d6c431db04d9d4947215e7b for partition [0x00000000, 0x0000000080000032) with scanner id null
12:14:44.384 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.385 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.385 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.386 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.386 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.387 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512884386 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:44.387 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.387 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.387 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.387 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.387 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.390 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=2e28ef28002144c494838792109461cd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.390 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 2e28ef28002144c494838792109461cd for partition [0x0000000080000032, 0x0000000080000096) with scanner id null
12:14:44.397 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:14:44.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:14:44.401 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=767e235fa4084d34a4e3b5d8f3c13bf6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.401 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdf1b5ce7, L:/127.0.0.1:41162 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.401 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 767e235fa4084d34a4e3b5d8f3c13bf6 for partition [0x0000000080000096, 0x00000001) with scanner id null
12:14:44.402 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.410 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 8 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=3d791a6cfc10469bb128ef6a9e6ab5f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.426 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 3d791a6cfc10469bb128ef6a9e6ab5f2 for partition [0x00000001, 0x0000000180000032) with scanner id null
12:14:44.434 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=9ae4e19d6d944f36af588d41dc8f2593, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.434 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 9ae4e19d6d944f36af588d41dc8f2593 for partition [0x0000000180000032, 0x0000000180000096) with scanner id null
12:14:44.438 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.439 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.439 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.439 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.439 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.440 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.440 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.440 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.440 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.440 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.441 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.442 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=36052c1a2c8c4d49ba87705834e15b86, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.442 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 36052c1a2c8c4d49ba87705834e15b86 for partition [0x0000000180000096, 0x00000002) with scanner id null
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.254:37603(127.17.135.254:37603)] disconnecting while in state READY
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer 95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)] disconnecting while in state READY
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.252:38447(127.17.135.252:38447)] disconnecting while in state READY
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] disconnecting while in state READY
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer master-127.17.135.253:43339(127.17.135.253:43339)] disconnecting while in state READY
12:14:44.443 [DEBUG - main] (Connection.java:575) [peer a23113f6788a4602994404c467dee91e(127.17.135.195:35771)] disconnecting while in state READY
12:14:44.444 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:44.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:44.444 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:44.445 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:44.445 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:44.445 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:44.445 [DEBUG - kudu-nio-4] (Connection.java:239) [peer a23113f6788a4602994404c467dee91e(127.17.135.195:35771)] handling channelInactive
12:14:44.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer a23113f6788a4602994404c467dee91e(127.17.135.195:35771)] cleaning up while in state READY due to: connection closed
12:14:44.449 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.451 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.452 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.457 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7c892f17, L:/127.0.0.1:41176 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.461 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] handling channelInactive
12:14:44.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] cleaning up while in state READY due to: connection closed
12:14:44.462 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.463 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
12:14:44.463 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
12:14:44.464 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.464 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
12:14:44.464 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
12:14:44.465 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.478 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.479 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.479 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.480 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.480 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.480 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.480 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.480 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.480 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.480 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.484 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.485 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)] handling channelInactive
12:14:44.485 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 95706152c43f41ab8b4c6037c07ea936(127.17.135.193:45465)] cleaning up while in state READY due to: connection closed
12:14:44.485 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
12:14:44.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:44.486464 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 18309
12:14:44.512 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.519 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.522 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdefa64ce, L:/127.0.0.1:41182 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.529 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x0cf79acd, L:/127.0.0.1:41178 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.545 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=18e98bc7615e4665a6e500c1cab31dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.545 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [0122518a7054013ae7f7ae42cb96d02a5ab62b779e7293d1b22d877f9ed34047]
12:14:44.545 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [0122518a7054013ae7f7ae42cb96d02a5ab62b779e7293d1b22d877f9ed34047]
12:14:44.546 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:14:44.546 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:14:44.546 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.547 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 0122518a7054013ae7f7ae42cb96d02a5ab62b779e7293d1b22d877f9ed34047 finished by subtask 2; deferring removal (restored in pending)
12:14:44.547 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.550 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f8a9554e25a0285b5bffe5e9f39836f7129f6266e5f6c400d5eed376480aaa38'}]
12:14:44.551 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.553 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:14:44.554 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299996, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:44.575 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=386b64c8ec0c469ebd53d12eadb01231, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.576 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [e0046d73943bbede2b11dae3af8b88ce605b68127410754be707d8bc1b3bbbbe]
12:14:44.576 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e0046d73943bbede2b11dae3af8b88ce605b68127410754be707d8bc1b3bbbbe]
12:14:44.576 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:14:44.576 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:14:44.576 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.577 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.577 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e0046d73943bbede2b11dae3af8b88ce605b68127410754be707d8bc1b3bbbbe finished by subtask 3; deferring removal (restored in pending)
12:14:44.578 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='746f68173bae05b284d0e93dcfde558614c005eca19a765773442f90f0c9bafb'}]
12:14:44.579 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:44.601 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:44.601 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:44.601 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:44.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:44.602 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:44.602 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.602 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.602 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:44.602 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:44.607 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.607 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.607 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.607 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:14:44.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.622 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.623 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.623 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:14:44.627 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:14:44.639 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:44.640 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299996, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:44.640 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.640 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.640 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:44.640 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:44.641 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:44.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:44.642 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.642 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.642 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:44.642 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:44.644 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.644 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.644 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.645 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.645 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.645 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.645 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.645 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.645 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.645 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.645 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.646 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.646 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.657 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:44.658 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.664 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:44.667 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.671 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.672 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [df8756eaedd1149d5877fc5c9a0f0bb4253524632cc4e4713082bd7e5f1b240a]
12:14:44.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [df8756eaedd1149d5877fc5c9a0f0bb4253524632cc4e4713082bd7e5f1b240a]
12:14:44.673 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:14:44.673 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:14:44.673 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split df8756eaedd1149d5877fc5c9a0f0bb4253524632cc4e4713082bd7e5f1b240a finished by subtask 0; deferring removal (restored in pending)
12:14:44.676 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.677 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.684 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.689 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:44.690 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x81ce8fb7, L:/127.0.0.1:41206 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.722 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.722 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.722 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.723 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.723 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.723 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.723 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.723 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.723 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.724 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.724 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.732 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.732 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [e1d9d5a606980d62719dc611004df9b02f92755580bea2f69848a07e2e4e68ec]
12:14:44.732 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e1d9d5a606980d62719dc611004df9b02f92755580bea2f69848a07e2e4e68ec]
12:14:44.733 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:14:44.733 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:14:44.733 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.733 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.738 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e1d9d5a606980d62719dc611004df9b02f92755580bea2f69848a07e2e4e68ec finished by subtask 1; deferring removal (restored in pending)
12:14:44.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.755 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:44.760 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:44.760 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:44.760 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:44.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:44.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:44.761 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:44.761 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:44.761 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [746f68173bae05b284d0e93dcfde558614c005eca19a765773442f90f0c9bafb]
12:14:44.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:44.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:44.761 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:44.761 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [746f68173bae05b284d0e93dcfde558614c005eca19a765773442f90f0c9bafb]
12:14:44.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:44.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:44.761 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:44.762 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:14:44.762 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:14:44.762 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6c610901, L:/127.0.0.1:41196 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:44.762 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.763 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 746f68173bae05b284d0e93dcfde558614c005eca19a765773442f90f0c9bafb finished by subtask 3; deferring removal (restored in pending)
12:14:44.763 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.778 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268774006784001) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:44.779 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [f8a9554e25a0285b5bffe5e9f39836f7129f6266e5f6c400d5eed376480aaa38]
12:14:44.779 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f8a9554e25a0285b5bffe5e9f39836f7129f6266e5f6c400d5eed376480aaa38]
12:14:44.779 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:14:44.779 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:14:44.780 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:44.780 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f8a9554e25a0285b5bffe5e9f39836f7129f6266e5f6c400d5eed376480aaa38 finished by subtask 2; deferring removal (restored in pending)
12:14:44.782 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:44.790410 18703 connection.cc:573] client connection to 127.17.135.193:45465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:44.790899 18703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:44.791999 18561 connection.cc:573] client connection to 127.17.135.193:45465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:44.792466 18561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:44.793939 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 18464
12:14:44.801 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:14:44.801 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.802 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:44.804988 18703 consensus_peers.cc:597] T 2e28ef28002144c494838792109461cd P a23113f6788a4602994404c467dee91e -> Peer 95706152c43f41ab8b4c6037c07ea936 (127.17.135.193:45465): Couldn't send request to peer 95706152c43f41ab8b4c6037c07ea936. Status: Network error: Client connection negotiation failed: client connection to 127.17.135.193:45465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:14:44.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:44.844 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.844 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.844 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.845 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.845 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.845 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.846 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.846 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:44.847 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:14:44.847 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.847 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.882 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.882 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.883 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:14:44.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512884885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:44.908 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:44.908 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:44.909 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:44.909 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:14:44.915 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=30 ms, finalizationTime=0 ms).
12:14:44.918 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split f8a9554e25a0285b5bffe5e9f39836f7129f6266e5f6c400d5eed376480aaa38 from pending
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split df8756eaedd1149d5877fc5c9a0f0bb4253524632cc4e4713082bd7e5f1b240a from pending
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split e0046d73943bbede2b11dae3af8b88ce605b68127410754be707d8bc1b3bbbbe from pending
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 0122518a7054013ae7f7ae42cb96d02a5ab62b779e7293d1b22d877f9ed34047 from pending
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 746f68173bae05b284d0e93dcfde558614c005eca19a765773442f90f0c9bafb from pending
12:14:44.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split e1d9d5a606980d62719dc611004df9b02f92755580bea2f69848a07e2e4e68ec from pending
12:14:44.918 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 6 finished splits from enumerator state
12:14:44.938 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:44.938 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:44.938 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:44.939 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.939 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.939 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:44.940 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.940 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.940 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:44.940 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:44.940 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:45.003 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:45.003 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:45.004 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:45.004 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.004 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.004 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.005 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.005 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:45.040 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] handling channelInactive
12:14:45.040 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] cleaning up while in state READY due to: connection closed
12:14:45.041 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] handling channelInactive
12:14:45.041 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] cleaning up while in state READY due to: connection closed
12:14:45.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:45.041951 18704 connection.cc:573] client connection to 127.17.135.194:38601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:45.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:45.046077 19350 negotiation.cc:336] Failed RPC negotiation. Trace:
12:14:45.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 12:14:45.044040 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.17.135.194:38601 (local address 127.17.135.195:39211)
12:14:45.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 12:14:45.044732 (+   692us) negotiation.cc:107] Waiting for socket to connect
12:14:45.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 12:14:45.044775 (+    43us) client_negotiation.cc:175] Beginning negotiation
12:14:45.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 12:14:45.045038 (+   263us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.135.194:38601: BlockingWrite error: write error: Connection reset by peer (error 104)
12:14:45.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":72}
12:14:45.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:45.047605 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 18681
12:14:45.060 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:45.060 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:45.060 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:45.061 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.061 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.061 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.061 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.061 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.061 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.061 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.061 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:45.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:45.159906 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17963
12:14:45.239 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:45.239 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:45.239 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:45.240 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.240 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.240 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:45.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:45.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:45.241 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:45.245 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:45.245 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:45.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:45.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:45.245 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:45.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:45.246 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.17.135.254:37603(127.17.135.254:37603)] handling channelInactive
12:14:45.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state READY due to: connection closed
12:14:45.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:45.247690 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 18034
12:14:45.259 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.308 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:45.308 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:45.309 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:45.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:45.308 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:45.309 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:45.315 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.17.135.253:43339(127.17.135.253:43339)] handling channelInactive
12:14:45.315 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state READY due to: connection closed
12:14:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:45.316982 17951 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 18175
12:14:45.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512885385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:45.389 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:45.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:45.389 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:45.389 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:45.392 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:45.392 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.17.135.252:38447(127.17.135.252:38447)] handling channelInactive
12:14:45.392 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:45.392 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state READY due to: connection closed
12:14:45.399 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 5184ffe83187ccec3ebfd9d613debdde (964 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:14:45.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:14:45.411 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:45.412 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:45.412 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:45.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.413 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.413 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.413 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.413 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.413 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.416 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:45.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:45.471 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:45.471 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:45.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.472 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.472 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.472 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.472 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.472 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.472 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.473 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:45.591 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:45.591 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:45.592 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:45.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:45.592 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.592 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.592 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:45.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:45.592 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:45.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.619 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:45.619 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:45.620 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:45.620 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:45.620 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:45.620 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:45.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:45.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:45.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:45.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:45.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:45.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:45.621 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:45.740 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:45.740 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:45.741 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.741 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:45.741 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:45.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:45.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:45.742 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:45.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:45.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512885885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:45.898 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 5184ffe83187ccec3ebfd9d613debdde (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:14:45.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:14:46.039 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:46.039 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:46.040 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:46.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.041 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.041 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.041 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.041 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:46.118 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:46.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:46.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:46.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.120 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.120 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.120 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.120 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.120 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.121 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.121 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:46.122 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.129 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:46.129 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:46.129 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:46.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.130 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.130 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.130 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.130 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.130 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:46.198 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:46.198 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:46.199 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:46.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.200 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.200 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.200 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.200 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.200 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.200 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.200 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.201 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.201 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:46.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.249 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:46.250 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:46.250 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:46.250 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.250 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.250 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:46.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.251 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:46.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.251 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.251 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:46.251 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:46.283 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:46.289 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:46.290 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:46.293 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='89ac612574f69c3d916c74881465dc207cc816022f9b3cc24772a8e0e741f5f6'}]
12:14:46.295 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.295 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4b9bd3c0b788b7210ebaeb1f8ade70733fd4f24fc835ce7c2a473a8acd5ea26a'}]
12:14:46.296 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d2afc807f26be5b35056ba6cd67bbdc07c41723e3df9d479ce8821c4cd4dbadb'}]
12:14:46.297 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:14:46.298 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299997, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:46.299 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='33a5c35f1be89c9ae9b8e6c0db20d812b7eb16c2c9e75f2f9befcc614c6ff42c'}]
12:14:46.300 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.301 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:14:46.301 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.304 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:14:46.305 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299997, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:46.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.311 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:46.312 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.312 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:14:46.312 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:46.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.352 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:46.352 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:46.352 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:46.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.353 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.353 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.353 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.354 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.354 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.354 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:46.356 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.364 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.369 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512886385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:46.388 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.393 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.396 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.400 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=15 ms, finalizationTime=0 ms).
12:14:46.402 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:14:46.407 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.410 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.411 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x62e61b2f, L:/127.0.0.1:41212 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.415 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.418 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.421 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:46.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:46.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:46.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.423 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.424 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.424 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.424 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:46.424 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=386b64c8ec0c469ebd53d12eadb01231, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.425 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [89ac612574f69c3d916c74881465dc207cc816022f9b3cc24772a8e0e741f5f6]
12:14:46.425 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [89ac612574f69c3d916c74881465dc207cc816022f9b3cc24772a8e0e741f5f6]
12:14:46.425 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:14:46.425 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:14:46.426 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 89ac612574f69c3d916c74881465dc207cc816022f9b3cc24772a8e0e741f5f6 finished by subtask 1; deferring removal (restored in pending)
12:14:46.427 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.427 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.428 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='328a5780817a46ca508d9f7bec643fbbf481fb2b350e6b290d1c85061252d582'}]
12:14:46.430 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.430 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:14:46.430 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:46.439 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.440 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.443 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb1a7cd18, L:/127.0.0.1:41222 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.445 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x791396d5, L:/127.0.0.1:41224 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.445 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.453 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.454 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4b9bd3c0b788b7210ebaeb1f8ade70733fd4f24fc835ce7c2a473a8acd5ea26a]
12:14:46.456 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4b9bd3c0b788b7210ebaeb1f8ade70733fd4f24fc835ce7c2a473a8acd5ea26a finished by subtask 3; deferring removal (restored in pending)
12:14:46.456 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [4b9bd3c0b788b7210ebaeb1f8ade70733fd4f24fc835ce7c2a473a8acd5ea26a]
12:14:46.456 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:14:46.456 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:14:46.457 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='78b968bae534cb04c1321c7cd10d1b3d7d3ac1d3a658c36fb7fd13ceaf4ff453'}]
12:14:46.457 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.458 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:46.459 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:14:46.460 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:46.460 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.461 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.465 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x39daf515, L:/127.0.0.1:41238 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.479 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.479 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.479 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:14:46.521 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.529 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:46.537 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.537 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.537 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:14:46.542 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.550 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.553 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:46.557 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:46.577 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.585 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:46.590 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb955a66a, L:/127.0.0.1:41244 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.590 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7d8bd038, L:/127.0.0.1:41250 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:46.597 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.598 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [78b968bae534cb04c1321c7cd10d1b3d7d3ac1d3a658c36fb7fd13ceaf4ff453]
12:14:46.598 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [78b968bae534cb04c1321c7cd10d1b3d7d3ac1d3a658c36fb7fd13ceaf4ff453]
12:14:46.598 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:14:46.598 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:14:46.599 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.599 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.601 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 78b968bae534cb04c1321c7cd10d1b3d7d3ac1d3a658c36fb7fd13ceaf4ff453 finished by subtask 3; deferring removal (restored in pending)
12:14:46.608 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.609 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [33a5c35f1be89c9ae9b8e6c0db20d812b7eb16c2c9e75f2f9befcc614c6ff42c]
12:14:46.609 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [33a5c35f1be89c9ae9b8e6c0db20d812b7eb16c2c9e75f2f9befcc614c6ff42c]
12:14:46.609 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:14:46.609 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:14:46.610 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.610 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 33a5c35f1be89c9ae9b8e6c0db20d812b7eb16c2c9e75f2f9befcc614c6ff42c finished by subtask 0; deferring removal (restored in pending)
12:14:46.611 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.655 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=18e98bc7615e4665a6e500c1cab31dda, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.656 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [d2afc807f26be5b35056ba6cd67bbdc07c41723e3df9d479ce8821c4cd4dbadb]
12:14:46.656 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d2afc807f26be5b35056ba6cd67bbdc07c41723e3df9d479ce8821c4cd4dbadb]
12:14:46.656 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:14:46.656 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:14:46.659 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d2afc807f26be5b35056ba6cd67bbdc07c41723e3df9d479ce8821c4cd4dbadb finished by subtask 2; deferring removal (restored in pending)
12:14:46.659 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.660 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.676 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.676 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:14:46.677 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:46.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:46.691 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:46.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.691 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.691 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.692 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.692 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:46.701 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268782198784001) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:46.702 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [328a5780817a46ca508d9f7bec643fbbf481fb2b350e6b290d1c85061252d582]
12:14:46.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [328a5780817a46ca508d9f7bec643fbbf481fb2b350e6b290d1c85061252d582]
12:14:46.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:14:46.702 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:14:46.703 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:46.703 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 328a5780817a46ca508d9f7bec643fbbf481fb2b350e6b290d1c85061252d582 finished by subtask 1; deferring removal (restored in pending)
12:14:46.703 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:46.707 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.707 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.707 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.707 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:14:46.718 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.718 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.719 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.719 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:14:46.731 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:46.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:46.731 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:46.731 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:14:46.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.762 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:46.762 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:46.762 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:46.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.763 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.763 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.763 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.764 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.764 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.764 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.764 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:46.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:46.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:46.792 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:46.793 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.793 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.793 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.793 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.793 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.793 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.793 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:46.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:46.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:46.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:46.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:46.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:46.800 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:46.800 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:46.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:46.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:46.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:46.801 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:46.801 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:46.801 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:46.828 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:46.829 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:46.829 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:46.829 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.829 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.829 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.830 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.830 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:46.830 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:46.830 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.830 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.830 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:46.830 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:46.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:46.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512886884 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:46.894 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:14:46.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 33a5c35f1be89c9ae9b8e6c0db20d812b7eb16c2c9e75f2f9befcc614c6ff42c from pending
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 78b968bae534cb04c1321c7cd10d1b3d7d3ac1d3a658c36fb7fd13ceaf4ff453 from pending
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 89ac612574f69c3d916c74881465dc207cc816022f9b3cc24772a8e0e741f5f6 from pending
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 328a5780817a46ca508d9f7bec643fbbf481fb2b350e6b290d1c85061252d582 from pending
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 4b9bd3c0b788b7210ebaeb1f8ade70733fd4f24fc835ce7c2a473a8acd5ea26a from pending
12:14:46.897 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split d2afc807f26be5b35056ba6cd67bbdc07c41723e3df9d479ce8821c4cd4dbadb from pending
12:14:46.897 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 6 finished splits from enumerator state
12:14:46.984 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:46.984 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:46.984 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:46.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.985 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:46.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.985 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:46.986 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.986 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.986 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:46.986 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:47.041 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:47.041 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:47.041 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:47.042 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:47.042 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:47.042 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:47.042 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:47.042 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:47.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:47.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:47.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:47.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:47.043 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:47.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:47.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:47.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:47.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.350 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.350 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.350 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.350 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.350 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:47.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512887385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:47.394 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 5184ffe83187ccec3ebfd9d613debdde (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:47.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:14:47.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:47Z chronyd exiting
12:14:47.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:47.441 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:47.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:47.441 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:47.441 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:47.441 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:47.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:47.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:47.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:47.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:47.442 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:47.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:47.442 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:47.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:47.442 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:47.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:47.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:47.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:47.442 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:47.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:47.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:47.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:47.443 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:47.443 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:47.443 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:47.443 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:47.458 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:47.458 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:47.458 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:47.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.460 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.460 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.460 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.460 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:47.531 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:47.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:47.532 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:47.532 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.532 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.532 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.533 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.533 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.533 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.533 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:47.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.763 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:47.763 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:47.763 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:47.764 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.764 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.764 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:47.764 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.765 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.765 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:47.765 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.765 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.765 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:47.765 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:47.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:47.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512887885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:47.903 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 5184ffe83187ccec3ebfd9d613debdde (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:14:47.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:14:47.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:47.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:47.991 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:47.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.992 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.992 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:47.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:47.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.992 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:47.993 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:48.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.190 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:48.191 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:48.191 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:48.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.192 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.192 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.192 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.192 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.192 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:48.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.285 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2aa3e12bd98f4cbd85dcb859657dac53
12:14:48.300 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0b11d3194e5543248721bee067c8f278 for table 'replication_test_table' with partition [0x00000000, 0x0000000080000032)
12:14:48.300 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 386b64c8ec0c469ebd53d12eadb01231 for table 'replication_test_table' with partition [0x0000000080000032, 0x0000000080000096)
12:14:48.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4f7abeeb47504b5988bb5e1c49541acf for table 'replication_test_table' with partition [0x0000000080000096, 0x00000001)
12:14:48.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 18e98bc7615e4665a6e500c1cab31dda for table 'replication_test_table' with partition [0x00000001, 0x0000000180000032)
12:14:48.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a0e07e3365584bb38520a776f55ad0d2 for table 'replication_test_table' with partition [0x0000000180000032, 0x0000000180000096)
12:14:48.301 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 74735e91682e470180aaef67e499fada for table 'replication_test_table' with partition [0x0000000180000096, 0x00000002)
12:14:48.301 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x00000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299999, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299999, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299999, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299999, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299999, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}, Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299999, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x00000002, upperBoundPartitionKey=0x, ttl=299999}]
12:14:48.305 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='703d799592864348bde07894b625b355b6a073b5757d0b36a41c719d48b8e061'}]
12:14:48.306 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.307 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5b9d87b5280183bb6e35b24ef40c3eb845ecda16b81ff3b30fc0494ec40fb887'}]
12:14:48.308 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.308 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ffcfa3b1e52c3f9e756b5f1ecdb3be9165b19d1a3ca0bbf063529b0ec4a2bcc8'}]
12:14:48.310 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:14:48.310 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000000, upperBoundPartitionKey=0x0000000080000032, ttl=299998, tablet=0b11d3194e5543248721bee067c8f278@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:48.311 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ce27f65c13fd321068325b9ea6313adc1bfe94ce1e47653b2dadd44bbb3262a3'}]
12:14:48.313 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.313 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:14:48.314 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000032, upperBoundPartitionKey=0x0000000080000096, ttl=299998, tablet=386b64c8ec0c469ebd53d12eadb01231@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:48.322 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:48.322 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:48.322 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:48.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.323 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.323 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.324 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:48.326 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.326 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:14:48.327 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x00000001, upperBoundPartitionKey=0x0000000180000032, ttl=299997, tablet=18e98bc7615e4665a6e500c1cab31dda@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)[L],e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:48.331 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:14:48.332 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000080000096, upperBoundPartitionKey=0x00000001, ttl=299997, tablet=4f7abeeb47504b5988bb5e1c49541acf@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:48.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.353 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.359 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.364 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.369 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512888385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:48.402 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:14:48.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:14:48.411 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.414 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.428 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.440 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.443 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4aedef3e, L:/127.0.0.1:41264 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.446 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] disconnecting while in state READY
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.126:33897(127.16.194.126:33897)] disconnecting while in state READY
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] disconnecting while in state READY
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.124:36205(127.16.194.124:36205)] disconnecting while in state READY
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:48.473 [DEBUG - main] (Connection.java:575) [peer master-127.16.194.125:40961(127.16.194.125:40961)] disconnecting while in state READY
12:14:48.473 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.16.194.124:36205(127.16.194.124:36205)] handling channelInactive
12:14:48.473 [DEBUG - kudu-nio-4] (Connection.java:239) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] handling channelInactive
12:14:48.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state READY due to: connection closed
12:14:48.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] cleaning up while in state READY due to: connection closed
12:14:48.474 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.16.194.125:40961(127.16.194.125:40961)] handling channelInactive
12:14:48.474 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state READY due to: connection closed
12:14:48.474 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] handling channelInactive
12:14:48.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] cleaning up while in state READY due to: connection closed
12:14:48.473 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.16.194.126:33897(127.16.194.126:33897)] handling channelInactive
12:14:48.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state READY due to: connection closed
12:14:48.475 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:48.482 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:14:48.482 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
12:14:48.482 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:14:48.483 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-1
12:14:48.483 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-4
12:14:48.487 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.493 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.505 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.523 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa4245fc2, L:/127.0.0.1:41276 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.533 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.536 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.539 [DEBUG - kudu-nio-5] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.539 [DEBUG - kudu-nio-5] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.539 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
12:14:48.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.540725 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17506
12:14:48.555 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.600 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x55fcd2a7, L:/127.0.0.1:41288 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.607 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.613 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf3b0d979, L:/127.0.0.1:41292 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.630 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268790390784001) for scanner KuduScanner(table=replication_test_table, tablet=4f7abeeb47504b5988bb5e1c49541acf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:48.630 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [5b9d87b5280183bb6e35b24ef40c3eb845ecda16b81ff3b30fc0494ec40fb887]
12:14:48.630 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5b9d87b5280183bb6e35b24ef40c3eb845ecda16b81ff3b30fc0494ec40fb887]
12:14:48.631 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
12:14:48.631 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
12:14:48.631 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:48.631 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:48.631 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:48.632 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.632 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.632 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:48.632 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.632 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.632 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:48.632 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.632 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.632 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:48.632 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:48.633 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5b9d87b5280183bb6e35b24ef40c3eb845ecda16b81ff3b30fc0494ec40fb887 finished by subtask 2; deferring removal (restored in pending)
12:14:48.633 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:48.634 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='c02bbe9a1f74f6096963599fd16e88e71089b5068bb3d642429b4b0f08fe9cb3'}]
12:14:48.636 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.636 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
12:14:48.637 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000032, upperBoundPartitionKey=0x0000000180000096, ttl=299997, tablet=a0e07e3365584bb38520a776f55ad0d2@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941),b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)[L]]}]
12:14:48.637 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:48.649 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268790390784001) for scanner KuduScanner(table=replication_test_table, tablet=0b11d3194e5543248721bee067c8f278, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:48.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.648638 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17668
12:14:48.650 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [703d799592864348bde07894b625b355b6a073b5757d0b36a41c719d48b8e061]
12:14:48.650 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [703d799592864348bde07894b625b355b6a073b5757d0b36a41c719d48b8e061]
12:14:48.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
12:14:48.653 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
12:14:48.653 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:48.654 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 703d799592864348bde07894b625b355b6a073b5757d0b36a41c719d48b8e061 finished by subtask 3; deferring removal (restored in pending)
12:14:48.655 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:48.655 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='177709e587ebb3a1d43d2b94b31d1e4247e3541efc4a574e983a15fb34ffd116'}]
12:14:48.657 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:48.657 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 6
12:14:48.658 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000180000096, upperBoundPartitionKey=0x00000002, ttl=299997, tablet=74735e91682e470180aaef67e499fada@[5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)[L],b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145),e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)]}]
12:14:48.661 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.662 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:14:48.663 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.663 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.663 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:48.664 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.665 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:48.665 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:14:48.666 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] connecting to peer
12:14:48.667 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.672 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.674 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] Successfully connected to peer
12:14:48.676 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.194.67
12:14:48.683 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.688 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7bbd8be4, L:/127.0.0.1:41296 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.691 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:14:48.696 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa34d2e4d, L:/127.0.0.1:41306 - R:/127.16.194.67:34965] using SASL/PLAIN
12:14:48.708 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268790390784001) for scanner KuduScanner(table=replication_test_table, tablet=74735e91682e470180aaef67e499fada, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:48.708 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [177709e587ebb3a1d43d2b94b31d1e4247e3541efc4a574e983a15fb34ffd116]
12:14:48.708 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [177709e587ebb3a1d43d2b94b31d1e4247e3541efc4a574e983a15fb34ffd116]
12:14:48.709 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
12:14:48.709 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
12:14:48.710 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 177709e587ebb3a1d43d2b94b31d1e4247e3541efc4a574e983a15fb34ffd116 finished by subtask 3; deferring removal (restored in pending)
12:14:48.712 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:48.713 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:48.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:48.715224 17831 connection.cc:573] server connection from 127.16.194.66:32873 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:48.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.717007 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17810
12:14:48.718 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268790390784001) for scanner KuduScanner(table=replication_test_table, tablet=a0e07e3365584bb38520a776f55ad0d2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:14:48.719 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [c02bbe9a1f74f6096963599fd16e88e71089b5068bb3d642429b4b0f08fe9cb3]
12:14:48.719 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [c02bbe9a1f74f6096963599fd16e88e71089b5068bb3d642429b4b0f08fe9cb3]
12:14:48.719 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 6 because it is idle.
12:14:48.719 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 6
12:14:48.720 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split c02bbe9a1f74f6096963599fd16e88e71089b5068bb3d642429b4b0f08fe9cb3 finished by subtask 2; deferring removal (restored in pending)
12:14:48.720 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state READY
12:14:48.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:48.737 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.737 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:48.737 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
12:14:48.745 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.745 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:14:48.745 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 6 exited.
12:14:48.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:48.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:48.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:48.760 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.760 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.760 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.760 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.760 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.760 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.761 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.761 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965) for tablet 18e98bc7615e4665a6e500c1cab31dda: connection closed
12:14:48.761 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] handling channelInactive
12:14:48.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] cleaning up while in state READY due to: connection closed
12:14:48.761 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965) for tablet 386b64c8ec0c469ebd53d12eadb01231: connection closed
12:14:48.761 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:48.764 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] connecting to peer
12:14:48.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.761921 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17173
12:14:48.770 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.770 [DEBUG - kudu-nio-1] (Connection.java:709) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] cleaning up while in state CONNECTING due to: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.770 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145) for tablet 18e98bc7615e4665a6e500c1cab31dda: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.779 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] connecting to peer
12:14:48.781 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.781 [DEBUG - kudu-nio-1] (Connection.java:709) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] cleaning up while in state CONNECTING due to: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.781 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145) for tablet 386b64c8ec0c469ebd53d12eadb01231: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145
12:14:48.784 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] connecting to peer
12:14:48.791 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.16.194.126:33897(127.16.194.126:33897)] handling channelInactive
12:14:48.791 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state READY due to: connection closed
12:14:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:48.793195 17408 connection.cc:573] client connection to 127.16.194.126:33897 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:48.795536 17408 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:14:48.799 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] connecting to peer
12:14:48.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.801620 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17243
12:14:48.803 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.803 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.803 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941) for tablet 18e98bc7615e4665a6e500c1cab31dda: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.807 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941) for tablet 386b64c8ec0c469ebd53d12eadb01231: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941
12:14:48.820 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.821 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:48.822546 17408 consensus_peers.cc:597] T 00000000000000000000000000000000 P f404846cba944dcf8554423792b761fa -> Peer 2766681ead7343328dab9930593d968d (127.16.194.126:33897): Couldn't send request to peer 2766681ead7343328dab9930593d968d. Status: Network error: Client connection negotiation failed: client connection to 127.16.194.126:33897: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:14:48.823 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.823 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.823 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.824 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.824 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.831 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.16.194.124:36205(127.16.194.124:36205)] Successfully connected to peer
12:14:48.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:48.837 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.16.194.125:40961(127.16.194.125:40961)] Successfully connected to peer
12:14:48.838 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.840 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.16.194.125:40961(127.16.194.125:40961)] handling channelInactive
12:14:48.840 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state READY due to: connection closed
12:14:48.841 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:48.841816 17161 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 17327
12:14:48.843 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:48.844 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state NEGOTIATING due to: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961]
12:14:48.844 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961]
12:14:48.844 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.16.194.125:40961(127.16.194.125:40961)] handling channelInactive
12:14:48.850 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.851 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.16.194.124:36205(127.16.194.124:36205)] Successfully connected to peer
12:14:48.852 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.852 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.852 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.860 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:48.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:48.861 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:48.861 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.861 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:48.862 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.862 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.862 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:48.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:48.863 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:48.883 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.16.194.124:36205(127.16.194.124:36205)] handling channelInactive
12:14:48.883 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:48.883 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:48.883 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state READY due to: connection closed
12:14:48.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state NEGOTIATING due to: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205]
12:14:48.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state NEGOTIATING due to: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205]
12:14:48.883 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205]
12:14:48.883 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205]
12:14:48.883 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.883 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.883 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.16.194.124:36205(127.16.194.124:36205)] handling channelInactive
12:14:48.883 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.16.194.124:36205(127.16.194.124:36205)] handling channelInactive
12:14:48.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512888885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:48.898 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 5184ffe83187ccec3ebfd9d613debdde (5006 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:14:48.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
12:14:48.899 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split c02bbe9a1f74f6096963599fd16e88e71089b5068bb3d642429b4b0f08fe9cb3 from pending
12:14:48.899 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 177709e587ebb3a1d43d2b94b31d1e4247e3541efc4a574e983a15fb34ffd116 from pending
12:14:48.899 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 703d799592864348bde07894b625b355b6a073b5757d0b36a41c719d48b8e061 from pending
12:14:48.899 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 13 complete: removed split 5b9d87b5280183bb6e35b24ef40c3eb845ecda16b81ff3b30fc0494ec40fb887 from pending
12:14:48.899 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 13 complete: removed 4 finished splits from enumerator state
12:14:48.900 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.900 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.901 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.901 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.901 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.904 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.904 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.905 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.905 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.905 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.905 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.905 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.906 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.907 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.907 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.907 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.919 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.919 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.919 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.919 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.919 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.920 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.920 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.920 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.920 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.920 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.920 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.920 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.924 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.924 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.925 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.925 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.925 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.925 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.925 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.925 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.925 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.939 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.939 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.939 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.939 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.939 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.939 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.940 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.940 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.940 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.940 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.944 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.944 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.944 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.944 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.945 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.945 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.945 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.945 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.945 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.945 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.945 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.945 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.959 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.959 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.959 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.959 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.959 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.960 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.960 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.960 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.960 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.960 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.965 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.965 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.965 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.965 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.965 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.965 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.965 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.965 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.966 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.979 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.980 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.980 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.980 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.980 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.980 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.980 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.981 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.981 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.981 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.985 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:48.985 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:48.985 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:48.985 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.985 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.985 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.985 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.985 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:48.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.985 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:48.985 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:48.986 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:48.998 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:48.998 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:48.999 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:48.999 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:48.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:48.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:48.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:48.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:48.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:48.999 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:48.999 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:48.999 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:48.999 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:48.999 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.000 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.000 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.000 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.000 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.000 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.000 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.000 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.000 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.000 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.000 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.000 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.000 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.004 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.004 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.005 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.005 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.005 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.005 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.005 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.005 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.005 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.005 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.005 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.005 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.005 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.019 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.019 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.020 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.020 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.020 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.020 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.020 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.020 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.020 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.021 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.111 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:49.111 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:49.111 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:49.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.112 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.112 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.112 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.114 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:49.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.124 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.125 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.126 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.126 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.126 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.126 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.126 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.126 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.126 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.126 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.127 [INFO - pool-234-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.127 [WARN - pool-234-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.159 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.160 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.160 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.160 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.160 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.160 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.160 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.160 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.161 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.161 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.161 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.161 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.181 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:49.181 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:49.181 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:49.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:49.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:49.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:49.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:49.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:49.182 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:49.182 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:49.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:49.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:49.182 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:49.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.259 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.259 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:49.259 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.259 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:49.259 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.259 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:49.260 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.260 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.260 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.260 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.260 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.260 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.260 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.260 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.260 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.261 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.261 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.261 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.261 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:49.264 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.265 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.265 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.265 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.265 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.265 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.265 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.359 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:49.360 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:49.360 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:49.360 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:49.360 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:49.360 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:49.360 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:49.360 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:49.360 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:49.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:49.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:49.361 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:49.361 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:49.384 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.384 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.384 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.385 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.385 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.385 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.385 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.385 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.385 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.385 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.385 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.385 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512889385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:49.394 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:49.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:14:49.539 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:49.539 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:49.539 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:49.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.540 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.540 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.540 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.540 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.540 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.540 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:49.549 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:49.550 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:49.550 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:49.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.550 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:49.572 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:49.572 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:49.572 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:49.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.572 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.572 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:49.572 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.573 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.573 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:49.573 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:49.573 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:49.584 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:49.585 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:49.585 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:49.585 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.585 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.585 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.585 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.585 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.586 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.586 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.586 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.586 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:49.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.650 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:49.650 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:49.650 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:49.650 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.650 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.650 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:49.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:49.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:49.651 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:49.725 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.725 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.725 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.725 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.725 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.725 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.726 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.726 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.726 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.726 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.726 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.726 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.726 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.743 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:49.743 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:49.744 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:49.744 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.744 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.744 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.744 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.744 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.744 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.744 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.744 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.744 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:49.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:49.879 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:49.879 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:49.880 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:49.880 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.880 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.880 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.880 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.880 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.880 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.880 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:49.880 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:49.880 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:49.880 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:49.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512889885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:49.893 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:14:49.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:14:49.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:49Z chronyd exiting
12:14:49.963 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:49.964 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:49.964 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:49.964 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.964 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.964 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.964 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.964 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.964 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:49.964 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:49.964 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.964 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:49.964 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:50.003 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:50.003 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:50.004 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:50.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.004 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:50.082 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:50.083 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:50.083 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:50.083 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.083 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.083 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.083 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.083 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.083 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.083 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.083 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:50.101 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:50.101 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:50.101 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:50.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.102 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:50.108 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:50.109 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:50.109 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:50.109 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.109 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.109 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.109 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.109 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.109 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.109 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:50.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:50.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:50.119 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:50.119 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.119 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.119 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.119 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.119 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.119 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.119 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.119 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.119 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.120 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:50.145 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:50.145 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:50.145 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:50.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.145 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.145 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.145 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.145 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.146 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:50.181 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:50.181 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:50.182 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:50.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.182 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.182 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.182 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:50.239 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:50.239 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:50.239 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:50.239 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:50.239 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:50.240 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:50.240 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:50.240 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:50.240 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:50.240 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:50.240 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:50.240 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:50.240 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:50.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.379 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:50.379 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:50.380 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:50.380 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.380 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.380 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.380 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:50.380 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.380 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:50.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:50.380 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:50.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512890385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:50.393 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:14:50.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:14:50.479 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:50.479 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:50.479 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:50.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.480 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:50.480 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:50.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:50.480 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:50.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.811 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:50.811 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:50.811 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:50.811 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.811 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.811 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.812 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.812 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.812 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:50.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:50.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:50.812 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:50.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:50.839 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:50.839 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:50.839 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:50.839 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.839 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.839 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.839 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.839 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.839 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.839 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.840 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.840 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.840 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:50.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512890884 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:50.891 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:14:50.891 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:14:50.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:50.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:50.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:50.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.902 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:50.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:50.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:50.903 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
.12:14:51.001 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512891001
12:14:51.002 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512891001
12:14:51.005 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:14:51.008 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:14:51.009 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:14:51.009 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:14:51.009 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:14:51.009 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:14:51.012 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:14:51.117 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.121 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:51.122 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:51.122 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:51.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:51.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:51.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:51.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:51.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:51.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:51.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:51.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:51.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:51.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:51.131 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:51.131 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:51.132 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:51.132 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.132 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.132 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.132 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.132 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.132 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.132 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.132 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.132 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.132 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:51.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512891385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:51.393 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:14:51.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:14:51.401 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:51.401 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:51.401 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:51.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:51.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:51.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:51.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:51.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:51.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:51.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:51.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:51.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:51.402 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:51.420 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:14:51.420 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:14:51.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.423555 19477 mini_oidc.cc:150] Starting JWKS server
12:14:51.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.426748 19477 webserver.cc:533] Webserver started at http://127.0.0.1:37435/ using document root <none> and password file <none>
12:14:51.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.427218 19477 mini_oidc.cc:186] Starting OIDC Discovery server
12:14:51.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.428987 19477 webserver.cc:533] Webserver started at http://127.0.0.1:41803/ using document root <none> and password file <none>
12:14:51.450 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:51.450 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:51.450 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:51.451 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.451 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.451 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:51.451 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:51.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:51.451 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:51.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:51Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:14:51.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:14:51Z Disabled control of system clock
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.493147 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/logs
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data/info.pb
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.126:41267
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.126
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:51.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json with env {}
12:14:51.617 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.739 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:51.740 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:51.740 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:51.740 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:51.740 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:51.740 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:51.740 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:51.740 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:51.740 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:51.740 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:51.740 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:51.740 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:51.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:51.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.791530 19489 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:51.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.792145 19489 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:51.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.792704 19489 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:51.802 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:51.803 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:51.803 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:51.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:51.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:51.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:51.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:51.803 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:51.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:51.803 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:51.803 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:51.803 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:51.803 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.825436 19489 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:51.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.825773 19489 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.826064 19489 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.826332 19489 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:51.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.826604 19489 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.826809 19489 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37435/jwks.json
12:14:51.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:51.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.863513 19489 master_runner.cc:387] Master server non-default flags:
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.126:41267
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data/info.pb
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.126
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/logs
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:51.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.865091 19489 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:51.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:51.866892 19489 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:51.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.877936 19495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:51.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512891885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:51.897 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:14:51.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:14:52.040 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:52.040 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:52.041 [DEBUG - pool-150-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:52.041 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.041 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.041 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.042 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.042 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.042 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.042 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.042 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:52.043 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [14ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [40ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1600ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1602ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3701ms] refreshing cache from master, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3702ms] too many traces: truncated at 100 traces, deferred=Deferred@825192215(state=PENDING, result=null, callback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891), errback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891)))
12:14:52.044 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:52.045 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [14ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [40ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1600ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1602ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3701ms] refreshing cache from master, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3702ms] too many traces: truncated at 100 traces, deferred=Deferred@825192215(state=PENDING, result=null, callback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891), errback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:52.045 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:14:52.112 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:14:52.116 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27365), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [14ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [40ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1600ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1602ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3321ms] refreshing cache from master, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3701ms] refreshing cache from master, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3702ms] too many traces: truncated at 100 traces, deferred=Deferred@825192215(state=PENDING, result=null, callback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891), errback=(continuation of Deferred@1123207189 after retry RPC after error@51369495) -> (continuation of Deferred@714473474 after retry RPC after error@1611367824) -> (continuation of Deferred@879578084 after retry RPC after error@1227856912) -> (continuation of Deferred@1394803495 after retry RPC after error@1874340822) -> (continuation of Deferred@836005806 after retry RPC after error@78555800) -> (continuation of Deferred@1340058385 after retry RPC after error@1628954535) -> (continuation of Deferred@1940677940 after retry RPC after error@36174771) -> (continuation of Deferred@806510533 after retry RPC after error@1864844423) -> (continuation of Deferred@2142374290 after retry RPC after error@1115004852) -> (continuation of Deferred@1622871112 after retry RPC after error@904757156) -> (continuation of Deferred@1526472210 after retry RPC after error@882553542) -> (continuation of Deferred@217784657 after retry RPC after error@1387626293) -> (continuation of Deferred@1753475071 after retry RPC after error@158233771) -> (continuation of Deferred@1556753790 after retry RPC after error@637517061) -> (continuation of Deferred@1387534938 after retry RPC after error@671475595) -> (continuation of Deferred@631868968 after retry RPC after error@2103842829) -> (continuation of Deferred@259177265 after retry RPC after error@147602667) -> (continuation of Deferred@1643985684 after retry RPC after error@739696982) -> (continuation of Deferred@908557526 after retry RPC after error@1608852893) -> (continuation of Deferred@1464373486 after retry RPC after error@1288685312) -> (continuation of Deferred@1099154307 after retry RPC after error@926736355) -> (continuation of Deferred@610330122 after retry RPC after error@379966017) -> (continuation of Deferred@1239782605 after retry RPC after error@410487253) -> (continuation of Deferred@990149735 after retry RPC after error@51087004) -> (continuation of Deferred@1722624460 after retry RPC after error@1118846445) -> (continuation of Deferred@1523553944 after retry RPC after error@87020603) -> (continuation of Deferred@180583963 after retry RPC after error@1230992891)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:52.118 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:52.119 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
12:14:52.119 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:14:52.120 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:14:52.120 [WARN - flink-pekko.actor.default-dispatcher-7] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:14:52.121 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:52.159 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:52.160 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:52.160 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:52.161 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:52.161 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:52.161 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:52.161 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:52.161 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:52.162 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:52.162 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:52.162 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:52.162 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:52.162 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:52.249 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:52.249 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:52.250 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:52.250 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.250 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.250 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.250 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.251 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.251 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:52.251 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:52.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:52.351 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:52.351 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:52.351 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:52.352 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.352 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.352 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.353 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.353 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.353 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.353 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.353 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.353 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:52.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512892385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:52.397 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:14:52.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:14:52.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:52.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:52.431 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:52.432 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.432 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.432 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.433 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.433 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.433 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.433 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.433 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.433 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:52.464 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:52.464 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:52.464 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:52.465 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.465 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.465 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.465 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.466 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.466 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.467 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:52.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:52.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:52.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:52.480 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.480 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.480 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.480 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.480 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:52.480 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:52.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:52.481 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:52.490 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:52.490 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:52.490 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:52.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.492 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.492 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.492 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.492 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:52.509 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:52.509 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:52.509 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:52.510 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.510 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.510 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.510 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.510 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.511 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.511 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.511 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.511 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:52.560 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:52.561 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:52.561 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:52.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:52.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:52.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:52.562 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:52.562 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:52.562 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:52.563 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:52.563 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:52.563 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:52.563 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:52.564 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:52.564 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:52.565 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:52.565 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:52.565 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:52.565 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:52.565 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:52.565 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:52.565 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:52.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:52.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:52.566 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:52.566 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:52.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:52.759 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:52.760 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:52.760 [DEBUG - pool-152-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:52.761 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.761 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.761 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:52.761 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.761 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.761 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:52.762 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.762 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.762 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:52.762 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:52.763 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28085), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [30ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [36ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [37ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [462ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@1547629998(state=PENDING, result=null, callback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642), errback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642)))
12:14:52.764 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:52.764 [WARN - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28085), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [30ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [36ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [37ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [462ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@1547629998(state=PENDING, result=null, callback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642), errback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.254:45345
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:52.764 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:14:52.766 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:14:52.770 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28085), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [30ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [36ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [37ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [184ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [184ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [460ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [462ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1260ms] refreshing cache from master, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1261ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3060ms] refreshing cache from master, [3060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4640ms] refreshing cache from master, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4641ms] too many traces: truncated at 100 traces, deferred=Deferred@1547629998(state=PENDING, result=null, callback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642), errback=(continuation of Deferred@413306957 after retry RPC after error@43118709) -> (continuation of Deferred@1154350043 after retry RPC after error@1878386025) -> (continuation of Deferred@1675173922 after retry RPC after error@1858500212) -> (continuation of Deferred@1174297428 after retry RPC after error@90189871) -> (continuation of Deferred@798148753 after retry RPC after error@1916436161) -> (continuation of Deferred@1160359721 after retry RPC after error@1095503595) -> (continuation of Deferred@2023981075 after retry RPC after error@1506682288) -> (continuation of Deferred@1368824135 after retry RPC after error@1879899848) -> (continuation of Deferred@340483010 after retry RPC after error@1015029598) -> (continuation of Deferred@1496966440 after retry RPC after error@1314175609) -> (continuation of Deferred@9399610 after retry RPC after error@1019869338) -> (continuation of Deferred@718228110 after retry RPC after error@1101249244) -> (continuation of Deferred@977205615 after retry RPC after error@1228983194) -> (continuation of Deferred@428569350 after retry RPC after error@1159876529) -> (continuation of Deferred@144323579 after retry RPC after error@1195980137) -> (continuation of Deferred@93879749 after retry RPC after error@1385227520) -> (continuation of Deferred@189530434 after retry RPC after error@86019903) -> (continuation of Deferred@1133554699 after retry RPC after error@385739164) -> (continuation of Deferred@2102443024 after retry RPC after error@2080935410) -> (continuation of Deferred@985568908 after retry RPC after error@1140209998) -> (continuation of Deferred@993967388 after retry RPC after error@65126548) -> (continuation of Deferred@1302670482 after retry RPC after error@1063993377) -> (continuation of Deferred@1903414413 after retry RPC after error@2082166615) -> (continuation of Deferred@406726138 after retry RPC after error@2100368532) -> (continuation of Deferred@306821147 after retry RPC after error@877585642)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.254:45345
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:52.771 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:52.771 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:52.771 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:52.772 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.772 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:52.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.773 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.773 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:52.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:52.773 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:52.774 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:52.775 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
12:14:52.777 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:14:52.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:52.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512892885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:52.897 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:14:52.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:14:53.049 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:53.050 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:53.050 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:53.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.050 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.050 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.050 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.050 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.050 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.050 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.050 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:53.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:51.878002 19496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:53.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.077625 19498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:53.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.079963 19497 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1196 milliseconds
12:14:53.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.080462 19489 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.203s	user 0.421s	sys 0.762s
12:14:53.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.080735 19489 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.203s	user 0.422s	sys 0.762s
12:14:53.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.080928 19489 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:53.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.081957 19489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:53.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.084453 19489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:53.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.085789 19489 hybrid_clock.cc:648] HybridClock initialized: now 1783512893085757 us; error 40 us; skew 500 ppm
12:14:53.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.086596 19489 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:53.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.094050 19489 webserver.cc:533] Webserver started at http://127.19.5.126:38323/ using document root <none> and password file <none>
12:14:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.094990 19489 fs_manager.cc:362] Metadata directory not provided
12:14:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.095201 19489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:53.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.095675 19489 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:53.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.099957 19489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data/instance:
12:14:53.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c26c759c1344915a0d33ecb5a42cfda"
12:14:53.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:53 on dist-test-slave-vcgh"
12:14:53.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.101070 19489 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal/instance:
12:14:53.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c26c759c1344915a0d33ecb5a42cfda"
12:14:53.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:53 on dist-test-slave-vcgh"
12:14:53.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.109068 19489 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
12:14:53.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.115193 19505 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:53.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.116532 19489 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.116925 19489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9c26c759c1344915a0d33ecb5a42cfda"
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:53 on dist-test-slave-vcgh"
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.117245 19489 fs_report.cc:389] FS layout report
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data/data
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:53.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:53.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:53.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.178617 19489 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.180107 19489 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:53.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.180569 19489 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:53.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.249366 19489 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.126:41267
12:14:53.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.249437 19556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.126:41267 every 8 connection(s)
12:14:53.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.252147 19489 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/data/info.pb
12:14:53.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.257828 19557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:53.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.262202 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 19489
12:14:53.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.262704 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-0/wal/instance
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.267665 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/logs
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data/info.pb
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.125:34511
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.125
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:53.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json with env {}
12:14:53.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.271449 19557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } has no permanent_uuid. Determining permanent_uuid...
12:14:53.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.300485 19557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } has no permanent_uuid. Determining permanent_uuid...
12:14:53.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.302758 19509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.306835 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:53.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.356408 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 1
12:14:53.358 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:53.359 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:53.359 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:53.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:53.359 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:53.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:53.359 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:53.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:53.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:53.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:53.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:53.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:53.360 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:53.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.361250 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512893385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:53.392 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:14:53.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:14:53.421 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:53.421 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:53.421 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:53.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:53.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:53.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:53.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:53.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:53.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:53.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:53.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:53.422 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:53.422 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:53.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.429693 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 2
12:14:53.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.433750 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.525182 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 3
12:14:53.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.529500 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.578249 19559 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:53.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.578801 19559 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:53.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.579298 19559 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.611241 19559 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.611527 19559 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:53.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.611757 19559 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:53.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.611963 19559 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:53.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.612164 19559 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:53.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.612308 19559 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37435/jwks.json
12:14:53.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.648542 19559 master_runner.cc:387] Master server non-default flags:
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.125:34511
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data/info.pb
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.125
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/logs
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:53.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:53.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.649818 19559 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:53.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.651324 19559 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:53.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.661428 19568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.672931 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 4
12:14:53.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.678089 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:53.711 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:53.712 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:53.712 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:53.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.713 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.713 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.713 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.713 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:53.732 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:53.732 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:53.732 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:53.733 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.733 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.733 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:53.733 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.733 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.733 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:53.733 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.733 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.733 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:53.733 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:53.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:53.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:53.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512893885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:53.895 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:53.895 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:14:53.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:53.977540 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 5
12:14:53.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.983806 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:54.103 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:54.104 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:54.104 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:54.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.105 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:54.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:54.309 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.310 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.310 [DEBUG - pool-148-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.310 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.310 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.310 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.310 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.311 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.311 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.311 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.311 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.311 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.312 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29644), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [33ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [47ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [762ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2704ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [6780ms] refreshing cache from master, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6781ms] too many traces: truncated at 100 traces, deferred=Deferred@2143056969(state=PENDING, result=null, callback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519), errback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519)))
12:14:54.312 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:54.313 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29644), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [33ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [47ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [762ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2704ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [6780ms] refreshing cache from master, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6781ms] too many traces: truncated at 100 traces, deferred=Deferred@2143056969(state=PENDING, result=null, callback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519), errback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.313 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:14:54.315 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:14:54.317 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29644), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [4ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [33ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [47ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [47ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [80ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [181ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [321ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [762ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2704ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [6780ms] refreshing cache from master, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6781ms] too many traces: truncated at 100 traces, deferred=Deferred@2143056969(state=PENDING, result=null, callback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519), errback=(continuation of Deferred@130370868 after retry RPC after error@778008276) -> (continuation of Deferred@1546627929 after retry RPC after error@1085113001) -> (continuation of Deferred@1831656293 after retry RPC after error@940636610) -> (continuation of Deferred@423946490 after retry RPC after error@894474673) -> (continuation of Deferred@1043106701 after retry RPC after error@21871459) -> (continuation of Deferred@1064341640 after retry RPC after error@249301958) -> (continuation of Deferred@1425443187 after retry RPC after error@948741677) -> (continuation of Deferred@54756708 after retry RPC after error@1840200945) -> (continuation of Deferred@225615142 after retry RPC after error@1351806827) -> (continuation of Deferred@1340418232 after retry RPC after error@1538907393) -> (continuation of Deferred@1119609085 after retry RPC after error@93693558) -> (continuation of Deferred@1666444948 after retry RPC after error@1989633578) -> (continuation of Deferred@1798753293 after retry RPC after error@1127768331) -> (continuation of Deferred@1071841462 after retry RPC after error@1913161558) -> (continuation of Deferred@788753342 after retry RPC after error@800290668) -> (continuation of Deferred@150086812 after retry RPC after error@1047933155) -> (continuation of Deferred@178057736 after retry RPC after error@1042349088) -> (continuation of Deferred@670034364 after retry RPC after error@680604810) -> (continuation of Deferred@1173397282 after retry RPC after error@2080946752) -> (continuation of Deferred@619843188 after retry RPC after error@98978564) -> (continuation of Deferred@1152310549 after retry RPC after error@2110629242) -> (continuation of Deferred@1232635161 after retry RPC after error@2121357657) -> (continuation of Deferred@1283814903 after retry RPC after error@1551101800) -> (continuation of Deferred@1370421682 after retry RPC after error@627165519)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.318 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:54.318 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
12:14:54.319 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:14:54.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:54.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512894385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:54.399 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:54.399 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:54.399 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:54.400 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:54.400 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:54.400 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:54.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:54.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:54.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:54.401 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:54.401 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:54.401 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:54.401 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:54.402 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:14:54.404 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:14:54.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:54.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:54.422 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:54.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:54.423 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:54.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:54.423 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:54.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.531337 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 6
12:14:54.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:54.540012 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.125:34511: Network error: Client connection negotiation failed: client connection to 127.19.5.125:34511: connect: Connection refused (error 111)
12:14:54.550 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:14:54.551 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:14:54.555 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 71 for source Source: KuduSource to checkpoint.
12:14:54.555 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
12:14:54.556 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:54.556 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
12:14:54.556 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:14:54.557 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:54.558 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:54.563 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:14:54.566 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:14:54.567 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 71 for source Source: KuduSource to checkpoint.
12:14:54.567 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:54.567 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:54.568 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:54.568 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.568 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.568 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.568 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.568 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.569 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.569 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.569 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.569 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.569 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:54.568 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
12:14:54.569 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
12:14:54.569 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
12:14:54.570 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:54.570 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
12:14:54.570 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:14:54.571 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:14:54.571 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:14:54.571 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:14:54.572 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:14:54.572 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:14:54.572 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 3 to checkpoint 71 for source Source: KuduSource to checkpoint.
12:14:54.573 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cbd5329
12:14:54.573 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:54.573 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
12:14:54.573 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:54.573 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:54.574 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:14:54.575 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
12:14:54.575 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:14:54.575 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:14:54.576 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:14:54.577 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:14:54.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
12:14:54.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
12:14:54.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@e033edb
12:14:54.578 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:54.579 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:54.579 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:14:54.579 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:14:54.580 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e7159d9
12:14:54.584 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
12:14:54.584 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
12:14:54.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@661891d8
12:14:54.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:54.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:54.585 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:14:54.585 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:14:54.586 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d2fc4e9
12:14:54.587 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:54.590 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61ee5019
12:14:54.598 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:54.600 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:54.601 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.604 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.605 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.608 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.609 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.609 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.609 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.612 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.613 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.613 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.613 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.614 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.614 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.615 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.615 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.616 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.616 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.616 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.617 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.617 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.617 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.617 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.617 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.618 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.618 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.618 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.618 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.619 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.619 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.619 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.619 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.619 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.620 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.621 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.621 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.621 [DEBUG - pool-154-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.621 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.621 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.622 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.622 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.622 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.622 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.622 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.622 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.622 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.623 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.623 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29943), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [39ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [43ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [183ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [802ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2003ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [5600ms] refreshing cache from master, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5601ms] too many traces: truncated at 100 traces, deferred=Deferred@1804969504(state=PENDING, result=null, callback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350), errback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350)))
12:14:54.623 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.624 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:14:54.624 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.624 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.624 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.624 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.624 [WARN - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29943), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [39ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [43ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [183ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [802ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2003ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [5600ms] refreshing cache from master, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5601ms] too many traces: truncated at 100 traces, deferred=Deferred@1804969504(state=PENDING, result=null, callback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350), errback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.625 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:14:54.625 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.627 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
12:14:54.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.628 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.628 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.629 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29943), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [8ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [8ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [37ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [39ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [39ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [43ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [61ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [104ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [183ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [183ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [802ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [802ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1440ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2001ms] refreshing cache from master, [2001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2002ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2003ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [5600ms] refreshing cache from master, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5601ms] too many traces: truncated at 100 traces, deferred=Deferred@1804969504(state=PENDING, result=null, callback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350), errback=(continuation of Deferred@1573420469 after retry RPC after error@392933913) -> (continuation of Deferred@788967242 after retry RPC after error@1776592940) -> (continuation of Deferred@2002736496 after retry RPC after error@1039059704) -> (continuation of Deferred@663248624 after retry RPC after error@1801529317) -> (continuation of Deferred@1721244460 after retry RPC after error@770356237) -> (continuation of Deferred@1215303838 after retry RPC after error@718035066) -> (continuation of Deferred@212559732 after retry RPC after error@1956245552) -> (continuation of Deferred@1009117917 after retry RPC after error@1952606891) -> (continuation of Deferred@598029204 after retry RPC after error@403070880) -> (continuation of Deferred@191249791 after retry RPC after error@1815488906) -> (continuation of Deferred@1711644171 after retry RPC after error@1280583220) -> (continuation of Deferred@1986225924 after retry RPC after error@725908027) -> (continuation of Deferred@1635474590 after retry RPC after error@217297667) -> (continuation of Deferred@1631960798 after retry RPC after error@1767409007) -> (continuation of Deferred@1383902070 after retry RPC after error@1124491665) -> (continuation of Deferred@268014689 after retry RPC after error@581376780) -> (continuation of Deferred@355935029 after retry RPC after error@1699599083) -> (continuation of Deferred@651430079 after retry RPC after error@1018234898) -> (continuation of Deferred@280209978 after retry RPC after error@467859533) -> (continuation of Deferred@502631038 after retry RPC after error@699457610) -> (continuation of Deferred@618622268 after retry RPC after error@678680954) -> (continuation of Deferred@425988208 after retry RPC after error@939004326) -> (continuation of Deferred@1754344680 after retry RPC after error@1579122825) -> (continuation of Deferred@1740762282 after retry RPC after error@272868565) -> (continuation of Deferred@1909734489 after retry RPC after error@1408098594) -> (continuation of Deferred@1000469321 after retry RPC after error@919178724) -> (continuation of Deferred@1714379152 after retry RPC after error@1526153350)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.629 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.630 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:54.630 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
12:14:54.630 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
12:14:54.630 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.630 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:14:54.629 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.630 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.631 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.631 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.631 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.631 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.631 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.631 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.631 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.632 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.632 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.632 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.632 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.633 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.634 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.634 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.634 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.641 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.641 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.642 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.642 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.642 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.642 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.643 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.643 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.643 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.644 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.645 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.645 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.646 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.646 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.646 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.646 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.647 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.647 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.648 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.648 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.648 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.648 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.648 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.649 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.649 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.649 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.649 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.650 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.650 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.651 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.651 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.661 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.661 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.661 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.661 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.662 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.662 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.662 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.662 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.662 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.662 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.662 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.662 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.663 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29984), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [38ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [64ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [683ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1346111058(state=PENDING, result=null, callback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638), errback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638)))
12:14:54.663 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.664 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.664 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.665 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.665 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.665 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.665 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.665 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.665 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.665 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.665 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.666 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.666 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.666 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.666 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.666 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.667 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.667 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.668 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.668 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.668 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.669 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.670 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.670 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.670 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.670 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.670 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.670 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.670 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.670 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.671 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.670 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29984), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [38ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [64ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [683ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1346111058(state=PENDING, result=null, callback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638), errback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29984), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [38ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [64ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [683ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1346111058(state=PENDING, result=null, callback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638), errback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.676 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29984), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [38ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [64ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [683ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1346111058(state=PENDING, result=null, callback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638), errback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29984), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [6ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [9ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [17ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [17ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [36ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [38ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [63ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [64ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [64ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [82ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [83ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [102ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [103ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [143ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [183ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [184ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [184ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [242ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [682ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [683ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [2562ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [3360ms] refreshing cache from master, [3360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1346111058(state=PENDING, result=null, callback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638), errback=(continuation of Deferred@1968933365 after retry RPC after error@1801958274) -> (continuation of Deferred@515433533 after retry RPC after error@772177710) -> (continuation of Deferred@121331514 after retry RPC after error@1360402428) -> (continuation of Deferred@139888879 after retry RPC after error@355756484) -> (continuation of Deferred@1219176151 after retry RPC after error@702771657) -> (continuation of Deferred@365856234 after retry RPC after error@587375838) -> (continuation of Deferred@848208887 after retry RPC after error@5370198) -> (continuation of Deferred@1632752995 after retry RPC after error@1464052163) -> (continuation of Deferred@278211015 after retry RPC after error@524399042) -> (continuation of Deferred@1884587396 after retry RPC after error@974333948) -> (continuation of Deferred@57801320 after retry RPC after error@296522853) -> (continuation of Deferred@1166035825 after retry RPC after error@1720690938) -> (continuation of Deferred@1788984569 after retry RPC after error@534450804) -> (continuation of Deferred@1481054525 after retry RPC after error@1133818551) -> (continuation of Deferred@607492168 after retry RPC after error@1664771592) -> (continuation of Deferred@55842211 after retry RPC after error@1697844852) -> (continuation of Deferred@1833712962 after retry RPC after error@1576410309) -> (continuation of Deferred@2116875221 after retry RPC after error@51446474) -> (continuation of Deferred@263952839 after retry RPC after error@1657187521) -> (continuation of Deferred@2079152407 after retry RPC after error@1893794802) -> (continuation of Deferred@600299912 after retry RPC after error@1957747093) -> (continuation of Deferred@1703150581 after retry RPC after error@486699556) -> (continuation of Deferred@1373077 after retry RPC after error@1914367603) -> (continuation of Deferred@927252590 after retry RPC after error@962136048) -> (continuation of Deferred@519488277 after retry RPC after error@1002098638)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:14:54.676 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:14:54.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
12:14:54.677 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
12:14:54.677 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
12:14:54.677 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to CANCELING.
12:14:54.677 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
12:14:54.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
12:14:54.678 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:14:54.678 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
12:14:54.678 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:14:54.679 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:54.679 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
12:14:54.679 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
12:14:54.680 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.681 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.681 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:54.681 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:14:54.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.681 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.681 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.681 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.681 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.681 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.682 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.682 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.682 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.681 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:54.682 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.683 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.683 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.683 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.683 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.683 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:54.683 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:14:54.683 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:14:54.684 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.684 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:54.684 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:14:54.684 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:54.685 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.685 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.685 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.685 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.685 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.685 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.685 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.685 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.686 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:14:54.686 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:14:54.686 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:14:54.687 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.687 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.687 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.688 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.688 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
12:14:54.689 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
12:14:54.689 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
12:14:54.689 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CANCELING to CANCELED.
12:14:54.690 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:54.690 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:54.690 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:14:54.690 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:54.691 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:14:54.691 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:54.692 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:54.692 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:14:54.692 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.693 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.693 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.693 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.693 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.694 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:54.688 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.701 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.701 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.701 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.701 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.701 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.701 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.702 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.702 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.702 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.702 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.702 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.702 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.703 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.702 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.703 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.703 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.711 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:54.711 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:54.711 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:54.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:54.712 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.712 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.712 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:54.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:54.712 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:54.721 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.721 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.721 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.721 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.721 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.721 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.722 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.722 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.724 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.724 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.724 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.725 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.725 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.725 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.725 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.725 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.726 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.726 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.726 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.726 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.726 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.726 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.726 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.726 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.727 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.727 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.727 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.727 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.741 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.741 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.741 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.741 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.741 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.741 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.741 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.741 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.741 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.741 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.742 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.742 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.742 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.746 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.746 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.746 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.746 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.746 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.746 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.746 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.746 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.747 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.747 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.747 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.747 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:54.765 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.765 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.765 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.766 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.766 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.766 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.766 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.766 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.766 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.766 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.766 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.766 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.781 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.781 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.781 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.781 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.782 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.782 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.782 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.782 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.819 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:54.819 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:54.820 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:54.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:54.820 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.820 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.820 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:54.820 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.820 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.821 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:54.821 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:54.825 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.825 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.825 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.826 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.827 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:54.841 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.841 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.841 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.841 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.841 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.841 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.842 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.842 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.842 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.842 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.842 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:53.662381 19569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:54.861 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.861 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.862 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.862 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:54.862159 19571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:54.862 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.862 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.863 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.863 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.863 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.863 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:54.865468 19570 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1197 milliseconds
12:14:54.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.865617 19559 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:54.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.866896 19559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:54.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.869851 19559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:54.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.871244 19559 hybrid_clock.cc:648] HybridClock initialized: now 1783512894871190 us; error 48 us; skew 500 ppm
12:14:54.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.872045 19559 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.880589 19559 webserver.cc:533] Webserver started at http://127.19.5.125:34885/ using document root <none> and password file <none>
12:14:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.881526 19559 fs_manager.cc:362] Metadata directory not provided
12:14:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.881717 19559 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:54.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.882107 19559 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:54.884 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.885 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.885 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.885 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.885 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.885 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.885 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.885 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.885 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.885 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512894885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:54.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.886778 19559 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data/instance:
12:14:54.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "400ba87528b4431cab80d8a18ba12845"
12:14:54.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:54 on dist-test-slave-vcgh"
12:14:54.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.888144 19559 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal/instance:
12:14:54.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "400ba87528b4431cab80d8a18ba12845"
12:14:54.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:54 on dist-test-slave-vcgh"
12:14:54.894 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:14:54.895 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:14:54.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.898458 19559 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
12:14:54.904 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.904367 19620 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:54.904 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.905 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.905 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.905 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.905 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.905 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.905 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.905825 19559 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:14:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.906186 19559 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal
12:14:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "400ba87528b4431cab80d8a18ba12845"
12:14:54.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:54 on dist-test-slave-vcgh"
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.906544 19559 fs_report.cc:389] FS layout report
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data/data
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:54.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:54.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:54.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:54.921 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:54.921 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.921 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.921 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.921 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.921 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.922 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:54.922 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:54.922 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:54.922 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:54.961 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:54.962 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:54.962 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:54.962 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.962 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.962 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.962 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.962 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:54.962 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:54.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:54.963 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:54.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.964437 19559 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:54.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.966024 19559 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:54.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:54.966447 19559 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:55.001 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:55.001 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:55.001 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.001 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:55.002 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.002 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.002 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.002 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:55.002 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.003 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.003 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.003 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.003 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.002 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.003 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.003 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.003 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.005 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.005 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.005 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.005 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.005 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.005 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.005 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.005 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.006 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.006 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.036849 19559 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.125:34511
12:14:55.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.036938 19671 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.125:34511 every 8 connection(s)
12:14:55.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.039731 19559 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/data/info.pb
12:14:55.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.042402 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 19559
12:14:55.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.042843 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-1/wal/instance
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.045712 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/logs
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data/info.pb
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.124:34641
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.124
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json with env {}
12:14:55.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.046742 19672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:55.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.058573 19672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } has no permanent_uuid. Determining permanent_uuid...
12:14:55.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.083451 19672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } has no permanent_uuid. Determining permanent_uuid...
12:14:55.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.098518 19672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } has no permanent_uuid. Determining permanent_uuid...
12:14:55.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.101334 19623 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.105342 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.146 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.146 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.146 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.147 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.147 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.147 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.147 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.154891 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 1
12:14:55.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.159055 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.184 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.185 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.185 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.185 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.185 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.185 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.185 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.185 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.185 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.185 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.185 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.185 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.185 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.227509 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 2
12:14:55.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.231769 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:55.301 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.302 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.302 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.303 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.303 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.323222 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 3
12:14:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.327641 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:55.359 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:55.359 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:55.360 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:55.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:55.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:55.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:55.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:55.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:55.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:55.360 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:55.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:55.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:55.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:55.360 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:55.360 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:55.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:55.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:55.361 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:55.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:55.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:55.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:55.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:55.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:55.361 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:55.361 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:55.361 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:55.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.368782 19674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:55.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.369415 19674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:55.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.369894 19674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:55.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512895384 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:55.392 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:14:55.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:14:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.408857 19674 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:14:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.409169 19674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.409389 19674 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:14:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.409592 19674 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:14:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.409785 19674 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:14:55.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.409930 19674 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37435/jwks.json
12:14:55.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.445504 19674 master_runner.cc:387] Master server non-default flags:
12:14:55.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:55.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:55.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.124:34641
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37435/jwks.json
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data/info.pb
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.124
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/logs
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.446734 19674 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.448314 19674 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:55.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.458491 19684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.471083 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 4
12:14:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.476346 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.501 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:55.502 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.502 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.502 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:55.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:55.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:55.504 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:55.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:55.504 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:55.525 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.525 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.526 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.526 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.526 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.526 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.526 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.526 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.526 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.527 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.562 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.562 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.562 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.564 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.564 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.564 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.564 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.600499 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } attempt: 7
12:14:55.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.632000 19557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } has no permanent_uuid. Determining permanent_uuid...
12:14:55.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.649101 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.707610 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 1
12:14:55.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.715134 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:55.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.775753 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 5
12:14:55.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.784083 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.796648 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 2
12:14:55.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.804406 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:55.885 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:55.886 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:55.886 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:55.886 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.887 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.887 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:55.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:55.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.888 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:55.888 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:55.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512895885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:55.896344 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 3
12:14:55.898 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:14:55.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:14:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.906966 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:55.991 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:55.992 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:55.992 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:55.993 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:55.993 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:55.993 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:55.993 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:55.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:55.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:55.994 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:55.994 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:55.994 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:55.994 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:56.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.047485 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 4
12:14:56.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.053512 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:56.121 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:56.122 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:56.122 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:56.122 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:56.122 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:56.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:56.123 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:56.123 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:56.123 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:56.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:56.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:56.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:56.124 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:56.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:56.312 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:56.312 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:56.312 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:56.313 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.313 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.313 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.313 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.313 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.313 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.313 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.314 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.313 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.314 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.331602 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 6
12:14:56.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:56.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.336949 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 5
12:14:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.343406 19557 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:56.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:56.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:56.349 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:56.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.350 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.351 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.351 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.351 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.351 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:56.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.360781 19672 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.5.124:34641: Network error: Client connection negotiation failed: client connection to 127.19.5.124:34641: connect: Connection refused (error 111)
12:14:56.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512896385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:56.397 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:14:56.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:14:56.469 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:56.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:56.470 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:56.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:56.471 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.471 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.471 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:56.471 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.471 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.471 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:56.471 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:56.519 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:56.519 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:56.520 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:56.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.521 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.521 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.521 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.521 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:56.642 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:56.642 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:56.642 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:56.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.643 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.643 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.643 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.643 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.643 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.644 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.644 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:56.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:55.459148 19685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:56.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.691367 19687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:56.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.695180 19674 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.237s	user 0.436s	sys 0.757s
12:14:56.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.695541 19674 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.237s	user 0.436s	sys 0.757s
12:14:56.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:56.695492 19686 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1236 milliseconds
12:14:56.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.695833 19674 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:14:56.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.696990 19674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:14:56.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.699496 19674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:14:56.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.700887 19674 hybrid_clock.cc:648] HybridClock initialized: now 1783512896700853 us; error 38 us; skew 500 ppm
12:14:56.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.701676 19674 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:14:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.708734 19674 webserver.cc:533] Webserver started at http://127.19.5.124:44011/ using document root <none> and password file <none>
12:14:56.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.709784 19674 fs_manager.cc:362] Metadata directory not provided
12:14:56.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.710006 19674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:14:56.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.710462 19674 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:14:56.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.714591 19674 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data/instance:
12:14:56.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a12cb362b4694112a9112ed03d7f9231"
12:14:56.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:56 on dist-test-slave-vcgh"
12:14:56.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.715700 19674 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal/instance:
12:14:56.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a12cb362b4694112a9112ed03d7f9231"
12:14:56.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:56 on dist-test-slave-vcgh"
12:14:56.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.723516 19674 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
12:14:56.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.729512 19699 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:14:56.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.730671 19674 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.731006 19674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a12cb362b4694112a9112ed03d7f9231"
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:14:56 on dist-test-slave-vcgh"
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.731346 19674 fs_report.cc:389] FS layout report
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data/data
12:14:56.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:14:56.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:14:56.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:56.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.798013 19674 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:14:56.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.799575 19674 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:14:56.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.800041 19674 kserver.cc:163] Server-wide thread pool size limit: 3276
12:14:56.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:56.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.867901 19674 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.124:34641
12:14:56.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.867980 19751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.124:34641 every 8 connection(s)
12:14:56.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.870728 19674 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/data/info.pb
12:14:56.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.871539 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 19674
12:14:56.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.871925 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/master-2/wal/instance
12:14:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.877857 19752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:14:56.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512896885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:56.885 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:56.886 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:56.886 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:56.886 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.886 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.886 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:56.887 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.887 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.887 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:56.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:56.887 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:56.894 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:56.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.895846 19557 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 6
12:14:56.896 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:14:56.902 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:56.903 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:56.903 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:56.903 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:56.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:56.904 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.904 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.904 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:56.904 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:56.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.904677 19752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } has no permanent_uuid. Determining permanent_uuid...
12:14:56.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.926576 19752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } has no permanent_uuid. Determining permanent_uuid...
12:14:56.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.938580 19557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: Bootstrap starting.
12:14:56.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.939373 19752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } has no permanent_uuid. Determining permanent_uuid...
12:14:56.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.945860 19557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: Neither blocks nor log segments found. Creating new log.
12:14:56.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.947913 19557 log.cc:826] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: Log is configured to *not* fsync() on all Append() calls
12:14:56.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.958534 19557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: No bootstrap required, opened a new log
12:14:56.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.959607 19752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: Bootstrap starting.
12:14:56.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.967360 19752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: Neither blocks nor log segments found. Creating new log.
12:14:56.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.969545 19752 log.cc:826] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: Log is configured to *not* fsync() on all Append() calls
12:14:56.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.975699 19752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: No bootstrap required, opened a new log
12:14:56.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.982161 19557 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:56.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.982992 19557 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:56.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.983276 19557 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c26c759c1344915a0d33ecb5a42cfda, State: Initialized, Role: FOLLOWER
12:14:56.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.984534 19557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:56.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.987623 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:56.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.988418 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: This master's current role is: FOLLOWER
12:14:56.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.988889 19557 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: configured and running, proceeding with master startup.
12:14:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.995932 19752 raft_consensus.cc:359] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.996819 19752 raft_consensus.cc:385] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:56.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.997095 19752 raft_consensus.cc:740] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12cb362b4694112a9112ed03d7f9231, State: Initialized, Role: FOLLOWER
12:14:56.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:56.997989 19752 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.001780 19769 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.002744 19769 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.003551 19752 sys_catalog.cc:565] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: configured and running, proceeding with master startup.
12:14:57.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.031970 19777 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:57.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.032310 19777 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:57.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.017599 19489 master_runner.cc:187] Error getting master registration for 127.19.5.125:34511: OK, instance_id { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" instance_seqno: 1783512895017962 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:57.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.054033 19489 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:57.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.055025 19705 tablet.cc:2406] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:57.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.059538 19787 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:14:57.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.060002 19787 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:14:57.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.039390 19674 master_runner.cc:187] Error getting master registration for 127.19.5.125:34511: OK, instance_id { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" instance_seqno: 1783512895017962 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:14:57.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.091082 19674 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:14:57.099 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:57.099 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:57.100 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:57.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:57.100 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:57.100 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:57.100 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:57.100 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:57.100 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:57.100 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:57.100 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:57.100 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:57.101 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:57.122 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:57.123 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:57.123 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:57.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.124 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.124 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.124 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.124 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:57.140 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:57.141 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:57.141 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:57.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:57.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:57.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:57.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:57.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:57.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:57.142 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:57.142 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:57.142 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:57.142 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:57.164 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:57.165 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:57.165 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:57.165 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.165 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.165 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.165 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.165 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.165 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.166 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.166 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.166 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.166 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:57.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:57.189374 19511 tablet.cc:2406] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:14:57.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:57.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.252030 19769 raft_consensus.cc:493] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:14:57.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.252604 19769 raft_consensus.cc:515] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.256753 19532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a12cb362b4694112a9112ed03d7f9231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c26c759c1344915a0d33ecb5a42cfda" is_pre_election: true
12:14:57.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.257637 19532 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a12cb362b4694112a9112ed03d7f9231 in term 0.
12:14:57.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.256060 19769 leader_election.cc:290] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c26c759c1344915a0d33ecb5a42cfda (127.19.5.126:41267), 400ba87528b4431cab80d8a18ba12845 (127.19.5.125:34511)
12:14:57.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.260664 19703 leader_election.cc:304] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c26c759c1344915a0d33ecb5a42cfda, a12cb362b4694112a9112ed03d7f9231; no voters: 
12:14:57.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.263343 19769 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:14:57.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.263842 19769 raft_consensus.cc:493] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:14:57.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.264796 19769 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 0 FOLLOWER]: Advancing to term 1
12:14:57.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.277868 19769 raft_consensus.cc:515] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.281731 19769 leader_election.cc:290] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [CANDIDATE]: Term 1 election: Requested vote from peers 9c26c759c1344915a0d33ecb5a42cfda (127.19.5.126:41267), 400ba87528b4431cab80d8a18ba12845 (127.19.5.125:34511)
12:14:57.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.289117 19532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a12cb362b4694112a9112ed03d7f9231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c26c759c1344915a0d33ecb5a42cfda"
12:14:57.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.289686 19532 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 0 FOLLOWER]: Advancing to term 1
12:14:57.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.297271 19532 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a12cb362b4694112a9112ed03d7f9231 in term 1.
12:14:57.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.301987 19703 leader_election.cc:304] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c26c759c1344915a0d33ecb5a42cfda, a12cb362b4694112a9112ed03d7f9231; no voters: 
12:14:57.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.303601 19789 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 1 FOLLOWER]: Leader election won for term 1
12:14:57.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.305234 19789 raft_consensus.cc:697] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [term 1 LEADER]: Becoming Leader. State: Replica: a12cb362b4694112a9112ed03d7f9231, State: Running, Role: LEADER
12:14:57.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.306602 19789 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:57.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.333216 19769 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12cb362b4694112a9112ed03d7f9231. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.338263 19769 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: This master's current role is: LEADER
12:14:57.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.362118 19791 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:14:57.378 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:57.378 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:57.379 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:57.379 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.379 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.379 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.378713 19791 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:14:57.380 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.380 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.380 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.381 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.381 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.381 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.381 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:57.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512897385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:57.393 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:14:57.393 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:14:57.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.421233 19672 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } attempt: 7
12:14:57.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.426295 19532 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [term 1 FOLLOWER]: Refusing update from remote peer a12cb362b4694112a9112ed03d7f9231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:57.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.429062 19769 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:57.462 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:57.462 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:57.462 [DEBUG - pool-146-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:57.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:57.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:57.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:57.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.463740 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12cb362b4694112a9112ed03d7f9231. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.464 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:57.464 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:57.465 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:57.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.465248 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.470 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:57.470 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:57.470 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:57.470 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.487192 19763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.487923 19763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.494247 19672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: Bootstrap starting.
12:14:57.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.495034 19789 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.495734 19789 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: This master's current role is: LEADER
12:14:57.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.507513 19791 catalog_manager.cc:1383] Generated new cluster ID: 58282d18219a4212b921c039c56c42a1
12:14:57.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.507820 19791 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:14:57.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.509066 19672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: Neither blocks nor log segments found. Creating new log.
12:14:57.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.511406 19672 log.cc:826] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: Log is configured to *not* fsync() on all Append() calls
12:14:57.518 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:57.519 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:57.519 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:57.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:57.519 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.519 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.519 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:57.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:57.520 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:57.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.541945 19672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: No bootstrap required, opened a new log
12:14:57.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.558400 19791 catalog_manager.cc:1406] Generated new certificate authority record
12:14:57.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.560420 19791 catalog_manager.cc:1540] Loading token signing keys...
12:14:57.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.596742 19791 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231: Generated new TSK 0
12:14:57.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.597795 19791 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.615275 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:57.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/logs
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data/info.pb
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.65:0
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.65
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.65
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:57.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:14:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.632370 19672 raft_consensus.cc:359] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.633213 19672 raft_consensus.cc:385] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:14:57.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.633524 19672 raft_consensus.cc:740] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 400ba87528b4431cab80d8a18ba12845, State: Initialized, Role: FOLLOWER
12:14:57.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.634461 19672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } }
12:14:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.645720 19800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.646494 19800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.647812 19672 sys_catalog.cc:565] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: configured and running, proceeding with master startup.
12:14:57.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.648002 19647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a12cb362b4694112a9112ed03d7f9231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "400ba87528b4431cab80d8a18ba12845" is_pre_election: true
12:14:57.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.648881 19647 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a12cb362b4694112a9112ed03d7f9231 in term 0.
12:14:57.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.650247 19645 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 0 FOLLOWER]: Advancing to term 1
12:14:57.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.652940 19646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a12cb362b4694112a9112ed03d7f9231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "400ba87528b4431cab80d8a18ba12845"
12:14:57.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.659678 19645 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [term 1 FOLLOWER]: Refusing update from remote peer a12cb362b4694112a9112ed03d7f9231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:14:57.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.661336 19769 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:14:57.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.741741 19800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12cb362b4694112a9112ed03d7f9231. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.742416 19800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.742239 19807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:57.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.743619 19807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845 [sys.catalog]: This master's current role is: FOLLOWER
12:14:57.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:57.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:57.754068 19816 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:14:57.786 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:57.786 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:57.786 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:57.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:57.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:57.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:57.788 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:57.819 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:57.819 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:57.819 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:57.820 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:57.820 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:57.820 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:57.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:57.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:57.820 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:57.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:57.820 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:57.820 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:57.820 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:57.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:57.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512897885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:57.894 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:57.895 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:14:57.929 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:57.929 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:57.929 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:57.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:57.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:57.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:57.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:57.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:57.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:57.931 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:57.931 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:57.931 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:57.931 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:58.038 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:14:58.038 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:14:58.039 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:14:58.039 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:14:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.041450 19777 catalog_manager.cc:1295] Loaded cluster ID: 58282d18219a4212b921c039c56c42a1
12:14:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.041864 19777 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: loading cluster ID for follower catalog manager: success
12:14:58.048 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
12:14:58.049 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
12:14:58.049 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:14:58.049 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
12:14:58.050 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
12:14:58.050 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:14:58.050 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
12:14:58.051 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
12:14:58.051 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:14:58.051 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
12:14:58.051 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
12:14:58.052 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:14:58.052 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:14:58.054 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:58.055 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:14:58.056 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:14:58.057 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:14:58.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.057868 19769 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a12cb362b4694112a9112ed03d7f9231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c26c759c1344915a0d33ecb5a42cfda" member_type: VOTER last_known_addr { host: "127.19.5.126" port: 41267 } } peers { permanent_uuid: "400ba87528b4431cab80d8a18ba12845" member_type: VOTER last_known_addr { host: "127.19.5.125" port: 34511 } } peers { permanent_uuid: "a12cb362b4694112a9112ed03d7f9231" member_type: VOTER last_known_addr { host: "127.19.5.124" port: 34641 } } }
12:14:58.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.058588 19769 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12cb362b4694112a9112ed03d7f9231 [sys.catalog]: This master's current role is: LEADER
12:14:58.059 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:14:58.061 [INFO - Thread-40] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:14:58.061 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:14:58.063 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:14:58.063 [DEBUG - Thread-40] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:14:58.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:14:58.065 [INFO - Thread-40] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:14:58.066 [INFO - Thread-40] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:14:58.068 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:14:58.069 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:14:58.071 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
12:14:58.071 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
12:14:58.072 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f5daea3
12:14:58.072 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:58.072 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:58.072 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:14:58.072 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:14:58.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.068181 19777 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: acquiring CA information for follower catalog manager: success
12:14:58.075 [DEBUG - Thread-40] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:58.076 [INFO - Thread-40] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:14:58.078 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:14:58.079 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:14:58.081 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
12:14:58.081 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
12:14:58.084 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:58.084 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:58.084 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:58.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.085 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.085 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.085 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.085 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.085 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.085 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.086 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.086 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.086 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:58.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61f767e6
12:14:58.097 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:58.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:58.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:14:58.098 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:14:58.105 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6929a66f
12:14:58.105 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:14:58.107 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
12:14:58.107 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
12:14:58.108 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e8df69a
12:14:58.112 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:14:58.114 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:58.115 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:58.115 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:14:58.115 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:14:58.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.119644 19777 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 9c26c759c1344915a0d33ecb5a42cfda: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:58.121 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:58.121 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:58.121 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:58.121 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:14:58.122 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.122 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.122 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.123 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.123 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.123 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.124 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.124 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.124 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.124 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.124 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:58.125 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3f2b62f4
12:14:58.133 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bdbce71
12:14:58.134 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:58.146 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:58.154 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
12:14:58.154 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
12:14:58.155 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69ac21b7
12:14:58.156 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:14:58.156 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:14:58.158 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:14:58.158 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:14:58.164 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:58.165 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:58.165 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:58.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:58.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:58.165 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:58.165 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:58.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:58.165 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:58.166 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:58.166 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:58.166 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:58.166 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:58.166 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@654b183d
12:14:58.170 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:58.170 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:58.171 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:58.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.171 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.171 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.171 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.172 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.172 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.172 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.172 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:58.173 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:14:58.177 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.179 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:58.179 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:58.179 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:58.179 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:58.179 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:58.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:58.180 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:58.180 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:58.180 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:58.180 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:58.180 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:58.180 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:58.180 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:58.185 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.192 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.196 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.197 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.197 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.197 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.204 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.209 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.211 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.211 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.213 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.215 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.215 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.215 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.219 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.219 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.219 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.219 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.221 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.222 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.222 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.223 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.223 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.229 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.230 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.230 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.230 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.231 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.231 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.231 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.231 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.232 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.232 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.232 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.232 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.233 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.233968 19799 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:14:58.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.234597 19799 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:14:58.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.235 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.235301 19799 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:14:58.239 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.246 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.250 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.252 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.267 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.268 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.268 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.269 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.276 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.276 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.284 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.284 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.286 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.286 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.292 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.294 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.294381 19799 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:14:58.294 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.295686 19799 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.5.65
12:14:58.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.303 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.309 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.311 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.311 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.311 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.318 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.319 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.323 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.323 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.331 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.331 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.331 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.331 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.336 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.337 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.339 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.339 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.339 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.342 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.352 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.353 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.359 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.359208 19799 tablet_server_runner.cc:78] Tablet server non-default flags:
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal
12:14:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.65:0
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data/info.pb
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.65
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.65
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/logs
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:14:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:14:58.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.360891 19799 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:14:58.362 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.362 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.362 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.362964 19799 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:14:58.367 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.369 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.370 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.370 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.373 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.376 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.376 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.384 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.385 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512898385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:58.393 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.393 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.394 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:14:58.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:14:58.397 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.397487 19863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:14:58.402 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.403 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.406 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.406 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.406 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.406 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.417 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.417 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.417 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.417 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.418 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.418 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.418 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.418 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.418 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.419 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.419 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.420 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.420 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.420 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.421 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.422 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.422 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.422 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.422 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.424 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.424 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.424 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.424 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.425 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.425 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.426 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.426 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.426 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.426 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.426 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.427 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.427 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.428 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.428 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.428 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.429 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.429 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.429 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.429 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.429 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.430 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.431 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.431 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.431 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.431 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.433 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.433 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.433 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.433 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.434 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.434 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.434 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.434 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.434 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.434 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.434 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.434 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.434 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.434 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.435 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.435 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.438 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.438 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.438 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.438 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.438 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.439 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.439 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.439 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.439 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.440 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.440 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.445 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.445 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.445 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.445 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.445 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.445 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.446 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.446 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.446 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.446 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.446 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.446 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.446 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.446 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.446 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.446 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.447 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.447 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.452 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.452 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.452 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.453 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.453 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.454 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.454 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.454 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.454 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.455 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.457 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.458 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.458 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.458 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.458 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.458 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.459 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.459 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.459 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.459 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.464 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.464 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.465 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.465 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.465 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.465 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.465 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.466 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.466 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.466 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.466 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.466 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.466 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.466 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.467 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.467 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.467 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.467 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.467 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.467 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.468 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.468 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.472 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.472 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.472 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.472 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.472 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.472 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.472 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.473 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.473 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.473 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.485 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.485 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.485 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.485 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.486 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.486 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.486 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.486 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.486 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.486 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.486 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.486 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.487 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.487 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.487 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.487 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.487 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.488 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.494 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.494 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.494 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.495 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.495 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.495 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.498 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.498 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.498 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.499 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.499 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.499 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.499 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.499 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.499 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.499 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.499 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.499 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.499 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.505 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.505 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.505 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.506 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.506 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.506 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.506 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.506 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.506 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.506 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.512 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.513 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.513 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.514 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.518 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.518 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.518 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.519 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.519 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.519 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.519 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.519 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.519 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.519 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.519 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.519 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.520 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.533 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.534 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.534 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.534 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.534 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.534 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.534 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.534 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.534 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.534 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.535 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.536 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.536 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.536 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.536 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.538 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.538 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.538 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.538 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.538 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.538 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.539 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.539 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.539 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.539 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.546 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.546 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.546 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.547 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.547 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.547 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.547 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.547 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.547 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.548 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.548 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.548 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.548 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.567 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.567 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.567 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.567 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.567 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.567 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.568 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.568 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.568 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.568 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.605 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.605 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.605 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.605 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.606 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.606 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.606 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.606 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.606 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.606 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.607 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.612 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.612 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.613 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.613 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.634 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.634 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.634 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.635 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.636 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:58.690 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:58.691 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.691 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:58.692 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:58.692 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.692 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.692 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:58.692 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.692 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.693 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:58.693 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:58.698 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.698 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.698 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.698 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.699 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.699 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.699 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.699 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.699 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.699 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.699 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.699 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.766695 19816 catalog_manager.cc:1295] Loaded cluster ID: 58282d18219a4212b921c039c56c42a1
12:14:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.768337 19816 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: loading cluster ID for follower catalog manager: success
12:14:58.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.785136 19816 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: acquiring CA information for follower catalog manager: success
12:14:58.786 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.786 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.787 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.788 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.788 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.788 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.788 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.788 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.793 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.793 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.793 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.793 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.794 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.794 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.794 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:58.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:14:58.806015 19816 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 400ba87528b4431cab80d8a18ba12845: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:14:58.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:58.844 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.845 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.845 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.846 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.846 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.855 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.855 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.856 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.856 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.856 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.856 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.856 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.857 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.857 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.857 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.857 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.857 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.857 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.883 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:58.883 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:58.883 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:58.884 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.884 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.884 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:58.884 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.884 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:58.885 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.885 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.885 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:58.885 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:58.887 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512898886 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:58.898 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:14:58.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:14:58.925 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:58.926 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:58.926 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:58.926 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.926 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.926 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:58.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.927 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:58.927 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:58.927 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:58.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:58.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:58.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:58.933 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.933 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:58.933 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.933 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.933 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:58.933 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.933 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.934 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:58.934 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:59.020 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:59.021 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:59.021 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:59.021 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.022 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.022 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.023 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:59.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:59.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:59.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:59.081 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.081 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.086 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:59.102 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:59.103 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:59.103 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:59.103 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.103 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.103 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.103 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.103 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.103 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.104 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.104 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.104 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.104 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:59.125 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:14:59.125 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:14:59.125 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:14:59.126 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:59.126 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:59.126 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:14:59.127 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:59.127 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:59.127 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:14:59.127 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:59.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:59.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:14:59.127 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:14:59.158 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.159 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.159 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.160 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.160 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.160 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.161 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.161 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.161 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.161 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.161 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.161 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.173 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.173 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.173 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.174 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.174 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.174 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.174 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.175 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.281 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:14:59.281 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:14:59.281 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:14:59.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:14:59.283 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.283 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:14:59.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:14:59.283 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:14:59.285 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.286 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.286 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.286 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.286 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.287 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.287 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.287 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.287 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.338 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.345 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.345 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.345 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.346 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.346 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.346 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.347 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.347 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.347 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.347 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.365 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.366 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.366 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.366 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.366 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.366 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.367 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.367 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.368 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512899385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:59.398 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.398 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.399 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.399 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.399 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.399 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.400 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.400 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.400 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.400 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.400 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.403 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=18 ms, finalizationTime=0 ms).
12:14:59.406 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:14:59.426 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.426 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.426 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.427 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.427 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.427 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.427 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.427 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.427 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.428 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.428 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.428 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.428 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.468 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:59.469 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:59.469 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:59.469 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.469 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.469 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.470 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.470 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.470 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.470 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:59.511 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:59.511 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:59.511 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:59.512 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.512 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.512 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.512 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.512 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.512 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.512 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.512 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.512 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.512 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:59.573 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.574 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.574 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.575 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.575 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.580 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.580 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.580 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.580 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.645 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.646 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.646 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.647 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.647 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.647 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.647 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.647 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.647 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.647 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.647 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.648 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.648 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.651 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:14:59.651 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:14:59.652 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:14:59.652 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.652 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.652 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:14:59.652 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.653 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.653 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:14:59.653 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.653 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.653 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:14:59.653 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:14:59.691 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.699 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.699 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.699 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.701 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.701 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.701 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.701 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.701 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.713 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:14:59.713 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:14:59.713 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:14:59.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:59.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:59.714 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:14:59.714 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:59.714 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:59.715 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:14:59.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:59.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:59.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:14:59.715 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:14:59.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:14:59.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:14:59.800 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:14:59.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:59.800 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:59.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:14:59.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:59.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:59.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:14:59.801 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:59.802 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:59.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:14:59.802 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:14:59.818 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:14:59.818 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:14:59.819 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:14:59.819 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.819 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.819 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:14:59.820 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.820 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.820 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:14:59.820 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.820 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.820 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:14:59.821 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:14:59.836 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:14:59.881 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.882 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.882 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.882 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.882 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.882 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.883 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.883 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.883 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.883 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.884 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:14:59.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512899884 for job 5184ffe83187ccec3ebfd9d613debdde.
12:14:59.901 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:14:59.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:14:59.964 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:14:59.965 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:14:59.965 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:14:59.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.966 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:14:59.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:14:59.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:14:59.967 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:00.012 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:00.013 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:00.013 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:00.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:00.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:00.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:00.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:00.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:00.016 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:00.016 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:00.016 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:00.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:00.016 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:00.065 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:00.065 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:00.065 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:00.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.066 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.066 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.066 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.066 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.066 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.066 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.066 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.066 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.066 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:00.139 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:00.140 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:00.140 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:00.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:00.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:00.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:00.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:00.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:00.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:00.141 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:00.141 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:00.141 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:00.141 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:00.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:00.251 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:00.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.403627 19868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:00.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:14:58.401206 19865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:00.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.277527 19799 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:00.278069 19866 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1879 milliseconds
12:15:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.279811 19799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:00.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.289135 19799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:00.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.290585 19799 hybrid_clock.cc:648] HybridClock initialized: now 1783512900290513 us; error 70 us; skew 500 ppm
12:15:00.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.291638 19799 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.305858 19799 webserver.cc:533] Webserver started at http://127.19.5.65:38137/ using document root <none> and password file <none>
12:15:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.307050 19799 fs_manager.cc:362] Metadata directory not provided
12:15:00.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.307308 19799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:00.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.307839 19799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.313870 19799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data/instance:
12:15:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef7bb15de6bf4075800485dce5d135bb"
12:15:00.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:00 on dist-test-slave-vcgh"
12:15:00.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.315303 19799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal/instance:
12:15:00.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef7bb15de6bf4075800485dce5d135bb"
12:15:00.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:00 on dist-test-slave-vcgh"
12:15:00.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.325579 19799 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.011s	sys 0.001s
12:15:00.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.332834 19887 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:00.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.334183 19799 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.334561 19799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef7bb15de6bf4075800485dce5d135bb"
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:00 on dist-test-slave-vcgh"
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.334980 19799 fs_report.cc:389] FS layout report
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data/data
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:00.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:00.336 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:00.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512900385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:00.395 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:00.397 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:15:00.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.397238 19799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.398936 19799 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:00.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.399478 19799 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:00.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.402371 19799 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:00.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.407104 19799 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:00.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.407318 19799 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:00.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.407626 19799 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:00.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.407802 19799 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:00.493 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:00.493 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:00.493 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:00.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.494 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.494 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:00.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.494 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:00.495 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.495 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.495 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:00.495 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:00.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.562588 19799 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.65:45925
12:15:00.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.562738 19999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.65:45925 every 8 connection(s)
12:15:00.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.565536 19799 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/data/info.pb
12:15:00.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.572592 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 19799
12:15:00.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.573139 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-0/wal/instance
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.597090 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/logs
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data/info.pb
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.66:0
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.66
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.66
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:00.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:00.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.630008 20000 heartbeater.cc:344] Connected to a master server at 127.19.5.125:34511
12:15:00.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.630520 20000 heartbeater.cc:461] Registering TS with master...
12:15:00.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.631981 20000 heartbeater.cc:507] Master 127.19.5.125:34511 requested a full tablet report, sending...
12:15:00.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.635648 19637 ts_manager.cc:194] Registered new tserver with Master: ef7bb15de6bf4075800485dce5d135bb (127.19.5.65:45925)
12:15:00.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.637217 20002 heartbeater.cc:344] Connected to a master server at 127.19.5.126:41267
12:15:00.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.637552 20002 heartbeater.cc:461] Registering TS with master...
12:15:00.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.637583 20001 heartbeater.cc:344] Connected to a master server at 127.19.5.124:34641
12:15:00.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.637967 20001 heartbeater.cc:461] Registering TS with master...
12:15:00.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.638502 20002 heartbeater.cc:507] Master 127.19.5.126:41267 requested a full tablet report, sending...
12:15:00.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.638717 20001 heartbeater.cc:507] Master 127.19.5.124:34641 requested a full tablet report, sending...
12:15:00.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.641076 19716 ts_manager.cc:194] Registered new tserver with Master: ef7bb15de6bf4075800485dce5d135bb (127.19.5.65:45925)
12:15:00.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.641374 19522 ts_manager.cc:194] Registered new tserver with Master: ef7bb15de6bf4075800485dce5d135bb (127.19.5.65:45925)
12:15:00.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:00.643332 19716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.5.65:48719
12:15:00.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:00.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:00.791 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:00.792 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:00.792 [DEBUG - pool-160-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:00.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.792 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.792 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.792 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.792 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.793 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.793 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.793 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.793 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:00.793 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28539), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [7ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [47ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [111ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [119ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [120ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [183ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [222ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [262ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [702ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [702ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1244ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2380ms] refreshing cache from master, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@1625041386(state=PENDING, result=null, callback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498), errback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498)))
12:15:00.794 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:00.794 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28539), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [7ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [47ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [111ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [119ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [120ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [183ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [222ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [262ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [702ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [702ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1244ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2380ms] refreshing cache from master, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@1625041386(state=PENDING, result=null, callback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498), errback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:00.795 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:15:00.797 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:15:00.799 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=28539), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [7ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [45ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [47ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [111ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [119ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [120ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [183ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [222ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [262ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [701ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [702ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [702ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1244ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1244ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2380ms] refreshing cache from master, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@1625041386(state=PENDING, result=null, callback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498), errback=(continuation of Deferred@961660769 after retry RPC after error@1182042654) -> (continuation of Deferred@597288809 after retry RPC after error@579541385) -> (continuation of Deferred@358004854 after retry RPC after error@2005988536) -> (continuation of Deferred@459208588 after retry RPC after error@1633935935) -> (continuation of Deferred@1104573293 after retry RPC after error@823360219) -> (continuation of Deferred@1562188258 after retry RPC after error@588348004) -> (continuation of Deferred@1370368112 after retry RPC after error@2067879228) -> (continuation of Deferred@1311150527 after retry RPC after error@1716256837) -> (continuation of Deferred@1174493524 after retry RPC after error@924322845) -> (continuation of Deferred@1305073704 after retry RPC after error@1258399740) -> (continuation of Deferred@126262321 after retry RPC after error@1888026680) -> (continuation of Deferred@1929551513 after retry RPC after error@897251650) -> (continuation of Deferred@103718088 after retry RPC after error@1050592501) -> (continuation of Deferred@1502573545 after retry RPC after error@995959155) -> (continuation of Deferred@1231499788 after retry RPC after error@26672825) -> (continuation of Deferred@598000985 after retry RPC after error@1897938663) -> (continuation of Deferred@19371421 after retry RPC after error@930271286) -> (continuation of Deferred@846808460 after retry RPC after error@1121882658) -> (continuation of Deferred@2145938585 after retry RPC after error@1580916786) -> (continuation of Deferred@647465820 after retry RPC after error@275661358) -> (continuation of Deferred@744388638 after retry RPC after error@627848919) -> (continuation of Deferred@1060869197 after retry RPC after error@1571212982) -> (continuation of Deferred@48747412 after retry RPC after error@1182373777) -> (continuation of Deferred@629402351 after retry RPC after error@1312510871) -> (continuation of Deferred@1929134775 after retry RPC after error@2016646758) -> (continuation of Deferred@1113448221 after retry RPC after error@1458473770) -> (continuation of Deferred@1184334522 after retry RPC after error@586394792) -> (continuation of Deferred@242887388 after retry RPC after error@745494498)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:00.800 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:00.800 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:15:00.800 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RUNNING to RESTARTING.
12:15:00.800 [WARN - flink-pekko.actor.default-dispatcher-6] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:15:00.801 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
12:15:00.870 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:00.870 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:00.870 [DEBUG - pool-164-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:00.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:00.871 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.871 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.871 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:00.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:00.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:00.872 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28607), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [36ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [58ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [106ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [145ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [425ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [425ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [840ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [842ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1603ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@1873380794(state=PENDING, result=null, callback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385), errback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385)))
12:15:00.872 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:00.873 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28607), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [36ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [58ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [106ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [145ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [425ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [425ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [840ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [842ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1603ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@1873380794(state=PENDING, result=null, callback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385), errback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.188:40073
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:00.873 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:15:00.877 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:15:00.880 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28607), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [36ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [58ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [104ms] refreshing cache from master, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [106ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [106ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] refreshing cache from master, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [145ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [322ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [423ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [425ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [425ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [840ms] refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [842ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [842ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1601ms] refreshing cache from master, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1603ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3120ms] refreshing cache from master, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [3122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5301ms] refreshing cache from master, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5302ms] too many traces: truncated at 100 traces, deferred=Deferred@1873380794(state=PENDING, result=null, callback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385), errback=(continuation of Deferred@1905351980 after retry RPC after error@1347827312) -> (continuation of Deferred@1973940935 after retry RPC after error@1451240860) -> (continuation of Deferred@763589213 after retry RPC after error@1275540523) -> (continuation of Deferred@108844710 after retry RPC after error@1363666744) -> (continuation of Deferred@1742759639 after retry RPC after error@313765996) -> (continuation of Deferred@1914346874 after retry RPC after error@470469158) -> (continuation of Deferred@2016985518 after retry RPC after error@2005351957) -> (continuation of Deferred@1372622034 after retry RPC after error@465647412) -> (continuation of Deferred@634036307 after retry RPC after error@1811109225) -> (continuation of Deferred@1041294041 after retry RPC after error@754588344) -> (continuation of Deferred@1556279116 after retry RPC after error@770421152) -> (continuation of Deferred@349473006 after retry RPC after error@1745317654) -> (continuation of Deferred@594826709 after retry RPC after error@1407358634) -> (continuation of Deferred@1665267648 after retry RPC after error@812473185) -> (continuation of Deferred@834042436 after retry RPC after error@1990651166) -> (continuation of Deferred@439741437 after retry RPC after error@1087966601) -> (continuation of Deferred@1111440268 after retry RPC after error@61927624) -> (continuation of Deferred@913279296 after retry RPC after error@1045593921) -> (continuation of Deferred@92983388 after retry RPC after error@28853909) -> (continuation of Deferred@1272445547 after retry RPC after error@1716665383) -> (continuation of Deferred@898177153 after retry RPC after error@1984330827) -> (continuation of Deferred@37147722 after retry RPC after error@1978819375) -> (continuation of Deferred@146944000 after retry RPC after error@1294184823) -> (continuation of Deferred@2030282781 after retry RPC after error@521029385)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.188:40073
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:00.881 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:15:00.881 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:00.882 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
12:15:00.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512900885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:00.898 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:15:00.899 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:15:00.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:00.988137 20010 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:00.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:00.988655 20010 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:00.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:00.989198 20010 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:01.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:01.022650 20010 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:01.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:01.023561 20010 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.5.66
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:01.064117 20010 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.66:0
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data/info.pb
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.66
12:15:01.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.66
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/logs
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:01.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:01.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:01.065742 20010 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:01.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:01.067443 20010 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:01.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:01.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:01.079 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:01.080 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.080 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.080 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.080 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.080 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.080 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.081 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.081 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.081 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.081 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:01.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:01.081209 20016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:01.084 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:01.084 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:01.085 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:01.085 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.085 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.085 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.086 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.086 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:01.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:01.193 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:01.193 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:01.193 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:01.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.194 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.194 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.194 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.194 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.194 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.195 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:01.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:01.305 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:01.305 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:01.305 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:01.306 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.306 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.306 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.306 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.307 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.307 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.307 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:01.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.341 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.343 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.344 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29073), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [10ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [582ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [582ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1163ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [6940ms] refreshing cache from master, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [6941ms] too many traces: truncated at 100 traces, deferred=Deferred@1734602084(state=PENDING, result=null, callback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823), errback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823)))
12:15:01.344 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.345 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.345 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.345 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.346 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.346 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.346 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.346 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.345 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29073), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [10ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [582ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [582ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1163ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [6940ms] refreshing cache from master, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [6941ms] too many traces: truncated at 100 traces, deferred=Deferred@1734602084(state=PENDING, result=null, callback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823), errback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29073), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [10ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [582ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [582ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1163ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [6940ms] refreshing cache from master, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [6941ms] too many traces: truncated at 100 traces, deferred=Deferred@1734602084(state=PENDING, result=null, callback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823), errback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:01.355 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29073), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [10ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [582ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [582ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1163ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [6940ms] refreshing cache from master, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [6941ms] too many traces: truncated at 100 traces, deferred=Deferred@1734602084(state=PENDING, result=null, callback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823), errback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29073), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [9ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [10ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [30ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [32ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [45ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [47ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [48ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [83ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [281ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [282ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [282ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [581ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [582ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [582ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1160ms] refreshing cache from master, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1163ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1163ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [3103ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [6940ms] refreshing cache from master, [6940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [6941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [6941ms] too many traces: truncated at 100 traces, deferred=Deferred@1734602084(state=PENDING, result=null, callback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823), errback=(continuation of Deferred@1424280737 after retry RPC after error@1297074030) -> (continuation of Deferred@703618297 after retry RPC after error@1358990446) -> (continuation of Deferred@594789163 after retry RPC after error@280237212) -> (continuation of Deferred@998807015 after retry RPC after error@1857948932) -> (continuation of Deferred@1407840611 after retry RPC after error@1665736566) -> (continuation of Deferred@470911317 after retry RPC after error@39412222) -> (continuation of Deferred@505932351 after retry RPC after error@893318178) -> (continuation of Deferred@628463857 after retry RPC after error@1827294000) -> (continuation of Deferred@1304240768 after retry RPC after error@257970417) -> (continuation of Deferred@115078140 after retry RPC after error@945195996) -> (continuation of Deferred@475727732 after retry RPC after error@296823766) -> (continuation of Deferred@1210871311 after retry RPC after error@1151861949) -> (continuation of Deferred@9231355 after retry RPC after error@410763175) -> (continuation of Deferred@856483505 after retry RPC after error@923111809) -> (continuation of Deferred@1370539929 after retry RPC after error@343137423) -> (continuation of Deferred@1084135902 after retry RPC after error@1527546325) -> (continuation of Deferred@215419170 after retry RPC after error@105528211) -> (continuation of Deferred@850264813 after retry RPC after error@227753796) -> (continuation of Deferred@968468941 after retry RPC after error@1853397962) -> (continuation of Deferred@738411906 after retry RPC after error@947791449) -> (continuation of Deferred@1283262298 after retry RPC after error@1718707156) -> (continuation of Deferred@1357383117 after retry RPC after error@435006823)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:01.356 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:01.357 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
12:15:01.358 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:15:01.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:15:01.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to CANCELING.
12:15:01.358 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:15:01.358 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
12:15:01.359 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:15:01.360 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:15:01.360 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:01.360 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:15:01.360 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:15:01.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.361 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.362 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.362 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.363 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.360 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to CANCELING.
12:15:01.363 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:15:01.374 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:01.375 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:15:01.375 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:15:01.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.381 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.381 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.381 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.382 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.382 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.382 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.382 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.382 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.382 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.382 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.382 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.384 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
12:15:01.384 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:15:01.385 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CANCELING to CANCELED.
12:15:01.385 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:01.386 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
12:15:01.386 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c0988648dfcd43275159a42b4d64d13e
12:15:01.387 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512901386 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:01.394 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:15:01.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:15:01.400 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.401 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.401 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.401 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.401 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.401 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.402 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.402 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.402 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.402 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.420 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.420 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.421 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.421 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.421 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.421 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.421 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.422 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.422 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.422 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.422 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.422 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.423 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:01.423 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:01.424 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:01.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:01.424 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.424 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.424 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:01.425 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.425 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.425 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:01.425 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:01.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.440 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.441 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.441 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.441 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.441 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.441 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.441 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.442 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.443 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:01.443 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:01.444 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:01.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:01.444 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.444 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.444 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:01.445 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:01.445 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:01.445 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:01.445 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:01.445 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:01.445 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:01.445 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:01.445 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:01.445 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:01.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:01.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:01.446 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:01.446 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:01.446 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.446 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.446 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:01.446 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:01.500 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.500 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.500 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.500 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.501 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.501 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.501 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.501 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.501 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.501 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.501 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.501 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.501 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.540 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.540 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.541 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.541 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.541 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.541 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.541 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.541 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.541 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.542 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.542 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.542 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.542 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:01.646449 20001 heartbeater.cc:499] Master 127.19.5.124:34641 was elected leader, sending a full tablet report...
12:15:01.680 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:01.681 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:01.681 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.681 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.681 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:01.681 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.682 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.682 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:01.682 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:01.682 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.682 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.682 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:01.682 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:01.691 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:01.711 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:01.711 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:01.712 [DEBUG - pool-162-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:01.712 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:01.712 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:01.712 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:01.712 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:01.712 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:01.712 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:01.713 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:01.713 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:01.713 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:01.713 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:01.713 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29449), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [8ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [25ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [26ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [48ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [72ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [85ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [86ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [101ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [144ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [144ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [145ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [145ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [281ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [282ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [282ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [282ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [521ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [521ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [522ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [781ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [781ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [861ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [861ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [861ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [862ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2380ms] refreshing cache from master, [2380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2483ms] too many traces: truncated at 100 traces, deferred=Deferred@977371776(state=PENDING, result=null, callback=(continuation of Deferred@1036163685 after retry RPC after error@146095468) -> (continuation of Deferred@1975034987 after retry RPC after error@1130069470) -> (continuation of Deferred@1793312354 after retry RPC after error@1260177423) -> (continuation of Deferred@2067248891 after retry RPC after error@1671070158) -> (continuation of Deferred@389974793 after retry RPC after error@978281809) -> (continuation of Deferred@2081000589 after retry RPC after error@1261106739) -> (continuation of Deferred@682580636 after retry RPC after error@1770768181) -> (continuation of Deferred@1498829677 after retry RPC after error@1171369242) -> (continuation of Deferred@393766022 after retry RPC after error@545106739) -> (continuation of Deferred@1264277866 after retry RPC after error@53118054) -> (continuation of Deferred@1461882065 after retry RPC after error@449548597) -> (continuation of Deferred@189405967 after retry RPC after error@1544861620) -> (continuation of Deferred@521399523 after retry RPC after error@1503101965) -> (continuation of Deferred@48135763 after retry RPC after error@2064568491) -> (continuation of Deferred@2071613405 after retry RPC after error@505940819) -> (continuation of Deferred@1869988387 after retry RPC after error@1651756270) -> (continuation of Deferred@1264481242 after retry RPC after error@359828337) -> (continuation of Deferred@1423386406 after retry RPC after error@683640302) -> (continuation of Deferred@273146752 after retry RPC after error@292539386) -> (continuation of Deferred@2087465190 after retry RPC after error@673729136) -> (continuation of Deferred@123533078 after retry RPC after error@1745083420) -> (continuation of Deferred@1970617082 after retry RPC after error@526685678) -> (continuation of Deferred@2137007443 after retry RPC after error@167114143) -> (continuation of Deferred@1426832561 after retry RPC after error@1853593627) -> (continuation of Deferred@273642042 after retry RPC after error@917517473) -> (continuation of Deferred@1045883122 after retry RPC after error@215946339) -> (continuation of Deferred@1743415648 after retry RPC after error@1346919424) -> (continuation of Deferred@1506819971 after retry RPC after error@760763606) -> (continuation of Deferred@424515956 after retry RPC after error@200769025), errback=(continuation of Deferred@1036163685 after retry RPC after error@146095468) -> (continuation of Deferred@1975034987 after retry RPC after error@1130069470) -> (continuation of Deferred@1793312354 after retry RPC after error@1260177423) -> (continuation of Deferred@2067248891 after retry RPC after error@1671070158) -> (continuation of Deferred@389974793 after retry RPC after error@978281809) -> (continuation of Deferred@2081000589 after retry RPC after error@1261106739) -> (continuation of Deferred@682580636 after retry RPC after error@1770768181) -> (continuation of Deferred@1498829677 after retry RPC after error@1171369242) -> (continuation of Deferred@393766022 after retry RPC after error@545106739) -> (continuation of Deferred@1264277866 after retry RPC after error@53118054) -> (continuation of Deferred@1461882065 after retry RPC after error@449548597) -> (continuation of Deferred@189405967 after retry RPC after error@1544861620) -> (continuation of Deferred@521399523 after retry RPC after error@1503101965) -> (continuation of Deferred@48135763 after retry RPC after error@2064568491) -> (continuation of Deferred@2071613405 after retry RPC after error@505940819) -> (continuation of Deferred@1869988387 after retry RPC after error@1651756270) -> (continuation of Deferred@1264481242 after retry RPC after error@359828337) -> (continuation of Deferred@1423386406 after retry RPC after error@683640302) -> (continuation of Deferred@273146752 after retry RPC after error@292539386) -> (continuation of Deferred@2087465190 after retry RPC after error@673729136) -> (continuation of Deferred@123533078 after retry RPC after error@1745083420) -> (continuation of Deferred@1970617082 after retry RPC after error@526685678) -> (continuation of Deferred@2137007443 after retry RPC after error@167114143) -> (continuation of Deferred@1426832561 after retry RPC after error@1853593627) -> (continuation of Deferred@273642042 after retry RPC after error@917517473) -> (continuation of Deferred@1045883122 after retry RPC after error@215946339) -> (continuation of Deferred@1743415648 after retry RPC after error@1346919424) -> (continuation of Deferred@1506819971 after retry RPC after error@760763606) -> (continuation of Deferred@424515956 after retry RPC after error@200769025)))
12:15:01.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:01.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512901885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:01.897 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:15:01.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:15:02.013 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:02.014 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:02.014 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:02.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.015 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:02.049 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.050 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.050 [DEBUG - pool-156-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.051 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.051 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.051 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.051 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.051 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.051 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.052 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29808), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [18ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [19ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [20ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [54ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [59ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [60ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [60ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [66ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [66ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [126ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [132ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [132ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [163ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [224ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [362ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [362ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [363ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [363ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [403ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [463ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [463ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [941ms] refreshing cache from master, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [942ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [943ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [943ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [943ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2100ms] refreshing cache from master, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2102ms] too many traces: truncated at 100 traces, deferred=Deferred@1849026467(state=PENDING, result=null, callback=(continuation of Deferred@806743388 after retry RPC after error@1717216323) -> (continuation of Deferred@114960030 after retry RPC after error@1192476953) -> (continuation of Deferred@1483979690 after retry RPC after error@1798861915) -> (continuation of Deferred@1015103860 after retry RPC after error@1698911476) -> (continuation of Deferred@539495709 after retry RPC after error@135938031) -> (continuation of Deferred@1051084153 after retry RPC after error@1102922413) -> (continuation of Deferred@563998562 after retry RPC after error@2015447545) -> (continuation of Deferred@1948272137 after retry RPC after error@1596185098) -> (continuation of Deferred@285984883 after retry RPC after error@1662465322) -> (continuation of Deferred@368129871 after retry RPC after error@1413696625) -> (continuation of Deferred@465854170 after retry RPC after error@1092654829) -> (continuation of Deferred@1576504009 after retry RPC after error@328820162) -> (continuation of Deferred@705879013 after retry RPC after error@1866508212) -> (continuation of Deferred@234932567 after retry RPC after error@1450121760) -> (continuation of Deferred@1788751611 after retry RPC after error@9001243) -> (continuation of Deferred@139158060 after retry RPC after error@651941663) -> (continuation of Deferred@1034542281 after retry RPC after error@2007112678) -> (continuation of Deferred@606817596 after retry RPC after error@1546655113) -> (continuation of Deferred@789370194 after retry RPC after error@1209439870) -> (continuation of Deferred@917135597 after retry RPC after error@1785374700) -> (continuation of Deferred@587549110 after retry RPC after error@1608294094) -> (continuation of Deferred@974397648 after retry RPC after error@92186041) -> (continuation of Deferred@213845081 after retry RPC after error@934199790) -> (continuation of Deferred@749172075 after retry RPC after error@1552174635) -> (continuation of Deferred@686625838 after retry RPC after error@1762464108) -> (continuation of Deferred@2115382539 after retry RPC after error@10342900) -> (continuation of Deferred@1074915757 after retry RPC after error@1091966642) -> (continuation of Deferred@237438446 after retry RPC after error@1616607151), errback=(continuation of Deferred@806743388 after retry RPC after error@1717216323) -> (continuation of Deferred@114960030 after retry RPC after error@1192476953) -> (continuation of Deferred@1483979690 after retry RPC after error@1798861915) -> (continuation of Deferred@1015103860 after retry RPC after error@1698911476) -> (continuation of Deferred@539495709 after retry RPC after error@135938031) -> (continuation of Deferred@1051084153 after retry RPC after error@1102922413) -> (continuation of Deferred@563998562 after retry RPC after error@2015447545) -> (continuation of Deferred@1948272137 after retry RPC after error@1596185098) -> (continuation of Deferred@285984883 after retry RPC after error@1662465322) -> (continuation of Deferred@368129871 after retry RPC after error@1413696625) -> (continuation of Deferred@465854170 after retry RPC after error@1092654829) -> (continuation of Deferred@1576504009 after retry RPC after error@328820162) -> (continuation of Deferred@705879013 after retry RPC after error@1866508212) -> (continuation of Deferred@234932567 after retry RPC after error@1450121760) -> (continuation of Deferred@1788751611 after retry RPC after error@9001243) -> (continuation of Deferred@139158060 after retry RPC after error@651941663) -> (continuation of Deferred@1034542281 after retry RPC after error@2007112678) -> (continuation of Deferred@606817596 after retry RPC after error@1546655113) -> (continuation of Deferred@789370194 after retry RPC after error@1209439870) -> (continuation of Deferred@917135597 after retry RPC after error@1785374700) -> (continuation of Deferred@587549110 after retry RPC after error@1608294094) -> (continuation of Deferred@974397648 after retry RPC after error@92186041) -> (continuation of Deferred@213845081 after retry RPC after error@934199790) -> (continuation of Deferred@749172075 after retry RPC after error@1552174635) -> (continuation of Deferred@686625838 after retry RPC after error@1762464108) -> (continuation of Deferred@2115382539 after retry RPC after error@10342900) -> (continuation of Deferred@1074915757 after retry RPC after error@1091966642) -> (continuation of Deferred@237438446 after retry RPC after error@1616607151)))
12:15:02.081 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.081 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.081 [DEBUG - pool-158-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.082 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.082 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.082 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.082 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.082 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.082 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:02.206 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:02.206 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:02.206 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:02.207 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.207 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.207 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.207 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.207 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.207 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.208 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.208 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.208 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.208 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:02.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:02.282 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:02.282 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:02.282 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:02.282 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.282 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.282 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.283 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:02.349 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RESTARTING to RUNNING.
12:15:02.350 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job c0988648dfcd43275159a42b4d64d13e from Checkpoint 61 @ 1783512870892 for c0988648dfcd43275159a42b4d64d13e located at file:/tmp/junit5149282460191757602/checkpoints/c0988648dfcd43275159a42b4d64d13e/chk-61.
12:15:02.350 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
12:15:02.350 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:15:02.351 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
12:15:02.351 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:02.352 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
12:15:02.352 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:15:02.352 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
12:15:02.352 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:15:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
12:15:02.354 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:15:02.354 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
12:15:02.354 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:15:02.355 [INFO - Thread-41] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:15:02.355 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state TERMINATED
12:15:02.355 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:15:02.355 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state TERMINATED
12:15:02.355 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:02.356 [DEBUG - Thread-41] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state TERMINATED
12:15:02.356 [DEBUG - Thread-41] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:02.357 [INFO - Thread-41] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:15:02.357 [INFO - Thread-41] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:15:02.359 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:15:02.360 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:15:02.361 [DEBUG - Thread-41] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:02.362 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:15:02.363 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:15:02.364 [INFO - Thread-41] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:02.364 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
12:15:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
12:15:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1b20bb04
12:15:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:15:02.366 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:15:02.366 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
12:15:02.366 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
12:15:02.366 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55f29f34
12:15:02.366 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:02.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:02.367 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:15:02.367 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:15:02.370 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1c79481
12:15:02.371 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:02.372 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:15:02.372 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b57423b
12:15:02.373 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:15:02.374 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
12:15:02.374 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
12:15:02.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2c20530b
12:15:02.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:02.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:02.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:15:02.376 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:15:02.376 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:02.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512902384 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:02.387 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@13e9133d
12:15:02.390 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:02.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
12:15:02.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
12:15:02.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3dbc93d9
12:15:02.394 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:02.395 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:02.395 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:02.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:15:02.396 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:15:02.396 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:15:02.403 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@19fcd136
12:15:02.405 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:02.408 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:02.408 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:02.408 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:02.408 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:02.409 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.409 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.413 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.413 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.414 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.414 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.414 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.415 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.415 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.416 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.416 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.416 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.420 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.422 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.425 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.427 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:01.087231 20017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:02.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.437 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.437 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.442 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.444 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.445 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.445 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.445 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:02.448900 20010 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.363s	user 0.554s	sys 0.795s
12:15:02.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:02.449352 20010 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.364s	user 0.554s	sys 0.796s
12:15:02.450 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.451 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.451407 20010 server_base.cc:1061] running on GCE node
12:15:02.452 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.452 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.452 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:02.453086 20050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:02.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.454614 20010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:02.456 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.458 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.458 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.459148 20010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:02.460 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.460583 20010 hybrid_clock.cc:648] HybridClock initialized: now 1783512902460529 us; error 37 us; skew 500 ppm
12:15:02.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.461704 20010 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:02.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:02.469 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.469 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.469 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.469851 20010 webserver.cc:533] Webserver started at http://127.19.5.66:42813/ using document root <none> and password file <none>
12:15:02.470 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.470 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.470 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.470 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.471 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.471180 20010 fs_manager.cc:362] Metadata directory not provided
12:15:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.471483 20010 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.472115 20010 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:02.473 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.473 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.473 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.473 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.473 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.473 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.473 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.474 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.474 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.475 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.475 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.475 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.475 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.475 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.476 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.476 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.476 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.476 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.477 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.477 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.477 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.477 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.478441 20010 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data/instance:
12:15:02.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "431ead545e0a472b969830c473c49da6"
12:15:02.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:02 on dist-test-slave-vcgh"
12:15:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.479874 20010 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal/instance:
12:15:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "431ead545e0a472b969830c473c49da6"
12:15:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:02 on dist-test-slave-vcgh"
12:15:02.480 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.481 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.481 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.481 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.482 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.489056 20010 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.001s
12:15:02.490 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.492 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.493 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.493 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.495803 20069 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:02.497 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.497 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.497068 20010 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
12:15:02.497 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.497 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.497515 20010 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal
12:15:02.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "431ead545e0a472b969830c473c49da6"
12:15:02.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:02 on dist-test-slave-vcgh"
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.497923 20010 fs_report.cc:389] FS layout report
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data/data
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:02.501 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.501 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.501 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.501 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.501 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.501 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.502 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.502 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.502 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.502 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.502 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.502 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.503 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.503 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.503 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.503 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.504 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.504 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.504 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.504 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.504 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.505 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.505 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.505 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.505 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.505 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.505 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.509 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.509 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.509 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.509 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.509 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.510 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.510 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.510 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.510 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.510 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.510 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.510 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.510 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.510 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.510 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.510 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.512 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.512 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.512 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.512 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.512 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.513 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.513 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.513 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.514 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.515 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.516 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.516 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.516 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.517 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.517 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.517 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.517 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.517 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.517 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.517 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.523 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.523 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.523 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.523 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.523 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.524 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.524 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.524 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.524 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.524 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.524 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.524 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.524 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.529 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.529 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.529 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.529 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.529 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.530 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.530 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.530 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.530 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.530 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.530 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.530 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.531 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.531 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.531 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.533 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.534 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.536 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.536 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.536 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.536 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.536 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.536 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.536 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.536 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.536 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.537 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.537 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.537 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.537 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.537 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.537 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.537 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.537 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.538 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.538 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.538 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.538 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.543 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.543 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.543 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.544 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.544 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.544 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.544 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.549 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.550 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.550 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.550 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.550 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.550 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.550 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.550 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.550 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.551 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.551 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.551 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.551 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.551 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.551 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.551 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.553 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.554 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.554 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.554 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.554 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.554 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.554 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.554 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.554 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.554 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.554 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.554 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.554 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.555 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.556 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.556 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.556 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.556 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.556 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.557 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.562 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.563 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.563 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.563 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.563 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.563 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.563 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.563 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.564 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.564 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.564 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.569 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.569 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.569 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.570 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.570 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.570 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.570 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.570 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.570 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.570 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.570 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.570 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.570 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.570902 20010 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:02.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.572537 20010 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:02.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.573021 20010 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:02.573 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.573 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.573 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.573 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.573 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.573 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.573 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.574 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.574 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.574 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.574 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.574 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.574 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.575 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.575911 20010 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:02.576 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.576 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.576 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.576 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.576 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.576 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.576 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.576 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.576 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.576 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.576 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.577 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.582034 20010 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.582278 20010 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.582579 20010 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:02.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.582739 20010 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:02.583 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.583 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.583 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.585 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.585 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.585 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.585 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.589 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.589 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.589 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.589 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.589 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.589 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.590 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.590 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.590 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.590 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.590 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.590 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.590 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.590 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.591 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.591 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.594 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.594 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.595 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.595 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.595 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.603 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.603 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.603 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.604 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.610 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.610 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.610 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.611 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.611 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.611 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.611 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.611 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.611 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.611 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.613 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.613 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.613 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.614 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.649 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.649 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.649 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.650 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.650 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.650 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.650 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.650 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.650 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.650 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.650 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.650 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.650 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.653 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.653 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.653 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.653 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.653 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.653 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.653 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.653 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.653 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.654 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.654 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.654 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.654 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.656 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.656 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.656 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.656 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.656 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.656 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.656 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.656 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.657 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.657 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.657 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.657 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.663 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.663 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.663 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.663 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.663 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.663 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.663 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.664 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.664 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.664 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.664 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:02.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:02.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:02.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.686 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.686 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:02.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:02.687 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.687 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.687 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:02.687 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:02.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:02.695 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.696 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.696 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.696 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.697 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.697 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.697 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.697 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.697 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.724457 20010 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.66:38845
12:15:02.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.724571 20199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.66:38845 every 8 connection(s)
12:15:02.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.727078 20010 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/data/info.pb
12:15:02.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.733335 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20010
12:15:02.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.733861 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-1/wal/instance
12:15:02.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:02.753 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.753 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.753 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.754 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.754 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.754 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.754 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.754 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.754 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.755 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.756157 19477 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/logs
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data/info.pb
12:15:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.67:0
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.67
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.67
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:02.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:02.770 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.770 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.770 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.771 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.772 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.772 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.772 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.772 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.772 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.772 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.779 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:02.779 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:02.779 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:02.779 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:02.779 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:02.779 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:02.780 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:02.780 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:02.780 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:02.780 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:02.780 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:02.780 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:02.780 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:02.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.784970 20200 heartbeater.cc:344] Connected to a master server at 127.19.5.125:34511
12:15:02.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.785483 20200 heartbeater.cc:461] Registering TS with master...
12:15:02.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.786857 20200 heartbeater.cc:507] Master 127.19.5.125:34511 requested a full tablet report, sending...
12:15:02.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.790927 19637 ts_manager.cc:194] Registered new tserver with Master: 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:02.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.791153 20201 heartbeater.cc:344] Connected to a master server at 127.19.5.124:34641
12:15:02.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.791529 20201 heartbeater.cc:461] Registering TS with master...
12:15:02.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.792454 20201 heartbeater.cc:507] Master 127.19.5.124:34641 requested a full tablet report, sending...
12:15:02.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.794937 19716 ts_manager.cc:194] Registered new tserver with Master: 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:02.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.796720 19716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.5.66:54447
12:15:02.797 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.798 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.798 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.798 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.798 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.798 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.798 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.798 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.798 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.799 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.799 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.799 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:02.799 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:02.799 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:02.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:02.799 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:02.799 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:02.799 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:02.799 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:02.799 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:02.801 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:02.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:02.801 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:02.801 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:02.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.796937 20202 heartbeater.cc:344] Connected to a master server at 127.19.5.126:41267
12:15:02.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.805017 20202 heartbeater.cc:461] Registering TS with master...
12:15:02.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.805606 20202 heartbeater.cc:507] Master 127.19.5.126:41267 requested a full tablet report, sending...
12:15:02.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:02.807723 19522 ts_manager.cc:194] Registered new tserver with Master: 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:02.809 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.810 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.810 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.810 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.810 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.810 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.810 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.810 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.810 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.810 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.810 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.811 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.823 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:02.823 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:02.823 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:02.823 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.823 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:02.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.824 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:02.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:02.824 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:02.853 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:02.853 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:02.853 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:02.853 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.853 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.854 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:02.854 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.854 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.854 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:02.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:02.854 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:02.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512902884 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:02.897 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:15:02.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:15:02.903 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:02.904 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:02.904 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:02.904 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.904 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.904 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.904 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:02.904 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:02.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:02.904 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:02.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.005 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.006 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.006 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.006 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.006 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.006 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.006 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.006 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.006 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.006 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.006 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.049 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.049 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.050 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.050 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.050 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.050 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.050 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.050 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.050 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.050 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.063 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:03.063 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:03.063 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:03.063 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.063 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.063 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.063 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.064 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.064 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.064 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.064 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.064 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.064 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:03.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.094669 20210 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:03.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.095201 20210 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:03.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.095715 20210 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:03.113 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.114 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.114 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.114 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.114 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.114 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.114 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.114 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.114 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.129390 20210 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.130237 20210 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.5.67
12:15:03.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:03.168507 20210 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.5.84:43585
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.5.67:0
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data/info.pb
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.5.67
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.5.126:41267,127.19.5.125:34511,127.19.5.124:34641
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.5.67
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/logs
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:03.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:03.170121 20210 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:03.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:03.171809 20210 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:03.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.183946 20216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:03.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.196 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.196 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.197 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.197 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.197 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.197 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.198 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.198 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.198 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.198 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.198 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.198 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.198 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.199 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.199 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.199 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.199 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.199 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.200 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.200 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.200 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.200 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.200 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.200 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.200 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.200 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.206 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.206 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.206 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.206 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.206 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.206 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.206 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.207 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.207 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.207 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.207 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.207 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.213 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.213 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.213 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.215 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.230 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.230 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.230 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.231 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.231 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.231 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512903385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:03.393 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:03.393 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:03.393 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:03.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:03.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:03.394 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:03.394 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:03.394 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:03.395 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:03.395 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:03.395 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:03.395 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:03.395 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:03.398 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:15:03.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:15:03.439 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:03.439 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:03.440 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:03.440 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.440 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.440 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.440 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.440 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.440 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.440 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.440 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.440 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.440 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:03.443 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:03.443 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:03.443 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.443 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.443 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:03.443 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:03.443 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.443 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.444 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:03.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:03.444 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:03.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.470 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.470 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.470 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.471 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.471 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.471 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.472 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.472 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.472 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.472 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.472 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.472 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.472 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.587 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.587 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.588 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.590 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.590 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.590 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.591 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.591 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.591 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.591 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.591 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.591 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.591 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.638 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:03.638 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:03.638 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:03.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:03.640 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.640 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.640 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:03.640 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.640 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.640 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:03.641 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:03.664 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:03.665 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:03.665 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:03.665 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:03.665 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:03.665 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:03.665 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:03.665 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:03.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:03.665 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:03.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:03.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:03.666 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:03.697 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:03.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:03.801776 20201 heartbeater.cc:499] Master 127.19.5.124:34641 was elected leader, sending a full tablet report...
12:15:03.865 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:03.865 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:03.865 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:03.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:03.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:03.869 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.869 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.869 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:03.869 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:03.873 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.873 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.873 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.875 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512903885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:03.894 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:03.896 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:15:03.936 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:03.937 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:03.937 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:03.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:03.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:03.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.939 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.939 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:03.939 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:03.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:04.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:04.049 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:04.050 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:04.050 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:04.051 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:04.051 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:04.051 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:04.051 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:04.051 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:04.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:04.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:04.051 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:04.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.319054 19996 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad880 after lost signal to thread 19823
12:15:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.320430 19996 debug-util.cc:398] Leaking SignalData structure 0x7b08000addc0 after lost signal to thread 19999
12:15:04.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512904385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:04.398 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=2 ms).
12:15:04.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:15:04.421 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:04.421 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:04.421 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:04.422 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.423 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.423 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.423 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:04.443 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:04.444 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:04.444 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:04.444 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:04.444 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:04.444 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:04.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:04.444 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:04.445 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:04.445 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:04.445 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:04.445 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:04.445 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:04.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.604 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:04.605 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:04.605 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:04.605 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.605 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.605 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:04.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:04.605 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.606 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.606 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:04.606 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:04.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.772 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:04.772 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:04.772 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:04.773 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:04.773 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:04.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:04.774 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:04.774 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:04.774 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:04.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:04.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:04.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:04.774 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:04.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512904885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:04.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.587396 20215 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 20210
12:15:04.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.894261 20215 kernel_stack_watchdog.cc:198] Thread 20210 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:03.185259 20217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.895521 20210 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.711s	user 0.622s	sys 1.010s
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.895860 20210 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.712s	user 0.622s	sys 1.010s
12:15:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.897251 20219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:04.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:04.923533 20218 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1710 milliseconds
12:15:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.923559 20210 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:04.925 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=39 ms, finalizationTime=0 ms).
12:15:04.926 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:15:04.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.925272 20210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:04.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.933254 20210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:04.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.934656 20210 hybrid_clock.cc:648] HybridClock initialized: now 1783512904934542 us; error 126 us; skew 500 ppm
12:15:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.935521 20210 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.942284 20210 webserver.cc:533] Webserver started at http://127.19.5.67:33293/ using document root <none> and password file <none>
12:15:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.943421 20210 fs_manager.cc:362] Metadata directory not provided
12:15:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.943676 20210 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:04.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.944207 20210 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:04.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.948745 20210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data/instance:
12:15:04.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:04.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:04 on dist-test-slave-vcgh"
12:15:04.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.949983 20210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal/instance:
12:15:04.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:04.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:04 on dist-test-slave-vcgh"
12:15:04.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.957991 20210 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:15:04.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:04.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.964493 20227 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:04.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.965728 20210 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:15:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.966085 20210 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal
12:15:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:04 on dist-test-slave-vcgh"
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:04.966447 20210 fs_report.cc:389] FS layout report
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data/data
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:05.002 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:05.002 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:05.003 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:05.003 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.003 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.003 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.004 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.003 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.004 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.030165 20210 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.032079 20210 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.032586 20210 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.036090 20210 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.040988 20210 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.041177 20210 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.041405 20210 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.041589 20210 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:05.143 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:05.143 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:05.143 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:05.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.144 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.144 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.144 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.144 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.144 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.144 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:05.170 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:05.171 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:05.171 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:05.171 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.171 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.171 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.171 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.172 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.172 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.172 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.172 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.172 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:05.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.219 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:05.219 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:05.219 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:05.219 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.219 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:05.220 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.220 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.220 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:05.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.220 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.220 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:05.220 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:05.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.269 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:05.269 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:05.269 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:05.269 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.270 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.270 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.270 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.270 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.270 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.270 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.270 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:05.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.284018 20210 rpc_server.cc:307] RPC server started. Bound to: 127.19.5.67:38719
12:15:05.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.284155 20339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.5.67:38719 every 8 connection(s)
12:15:05.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.287518 20210 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/data/info.pb
12:15:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.292384 19477 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20210
12:15:05.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.293025 19477 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster2192808459643925064/ts-2/wal/instance
12:15:05.294 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:05.294 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:05.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:05.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:05.295 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:05.295 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:05.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:05.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:05.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:05.296 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:05.296 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:05.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:05.296 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:05.333 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:05.333 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:05.333 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:05.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.334 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.335 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.335 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.335 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.335 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:05.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.339196 20341 heartbeater.cc:344] Connected to a master server at 127.19.5.124:34641
12:15:05.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.339689 20341 heartbeater.cc:461] Registering TS with master...
12:15:05.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.340974 20341 heartbeater.cc:507] Master 127.19.5.124:34641 requested a full tablet report, sending...
12:15:05.343 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:05.343 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:05.343 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:05.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.343470 19716 ts_manager.cc:194] Registered new tserver with Master: 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:05.344 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.344 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.344 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:05.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.344 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.344 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:05.345 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.345 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.345 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:05.345 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:05.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.345135 19716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.5.67:37163
12:15:05.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.347922 20340 heartbeater.cc:344] Connected to a master server at 127.19.5.125:34511
12:15:05.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.348239 20340 heartbeater.cc:461] Registering TS with master...
12:15:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.348868 20340 heartbeater.cc:507] Master 127.19.5.125:34511 requested a full tablet report, sending...
12:15:05.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.351229 19637 ts_manager.cc:194] Registered new tserver with Master: 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:05.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.358064 20344 heartbeater.cc:344] Connected to a master server at 127.19.5.126:41267
12:15:05.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.358394 20344 heartbeater.cc:461] Registering TS with master...
12:15:05.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.359009 20344 heartbeater.cc:507] Master 127.19.5.126:41267 requested a full tablet report, sending...
12:15:05.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.361429 19522 ts_manager.cc:194] Registered new tserver with Master: 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.385322 19477 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:15:05.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512905385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:05.393 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:05.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:15:05.404 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:05.404 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:15:05.406 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.5.126"
      port: 41267
    }
    bound_http_address {
      host: "127.19.5.126"
      port: 38323
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.5.125"
      port: 34511
    }
    bound_http_address {
      host: "127.19.5.125"
      port: 34885
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.5.124"
      port: 34641
    }
    bound_http_address {
      host: "127.19.5.124"
      port: 44011
    }
  }
}

12:15:05.406 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:15:05.406 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.5.65"
      port: 45925
    }
    bound_http_address {
      host: "127.19.5.65"
      port: 38137
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.5.66"
      port: 38845
    }
    bound_http_address {
      host: "127.19.5.66"
      port: 42813
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.5.67"
      port: 38719
    }
    bound_http_address {
      host: "127.19.5.67"
      port: 33293
    }
  }
}

12:15:05.407 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:15:05.408 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:05.408 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:15:05.408 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:15:05.408 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:15:05.409 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:15:05.413 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:15:05.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.539 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:05.539 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:05.540 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:05.540 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:05.540 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:05.540 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:05.540 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:05.540 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:05.540 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:05.540 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:05.541 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:05.541 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:05.541 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:05.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.749 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.781 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:05.781 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:15:05.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.784907 20351 mini_oidc.cc:150] Starting JWKS server
12:15:05.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.788455 20351 webserver.cc:533] Webserver started at http://127.0.0.1:40937/ using document root <none> and password file <none>
12:15:05.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.788945 20351 mini_oidc.cc:186] Starting OIDC Discovery server
12:15:05.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.791110 20351 webserver.cc:533] Webserver started at http://127.0.0.1:34427/ using document root <none> and password file <none>
12:15:05.799 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:05.800 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:05.800 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:05.800 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:05.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:05.800 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:05.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:05.800 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:05.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:05.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:05.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:05.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:05.800 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:05.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:15:05.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:05Z Disabled control of system clock
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:05.858254 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/logs
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data/info.pb
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.254:42193
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.254
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json with env {}
12:15:05.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512905885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:05.894 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:05.894 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:15:05.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:05.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:05.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:05.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:05.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.977 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:05.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:05.977 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.977 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:05.977 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:06.038 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:06.038 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:06.038 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:06.039 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.039 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.039 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.039 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.039 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.039 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.039 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.039 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.039 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.039 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:06.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.192708 20363 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:06.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.193253 20363 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:06.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.193742 20363 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:06.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.227841 20363 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:06.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.228171 20363 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:06.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.228487 20363 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:06.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.228786 20363 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:06.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.229066 20363 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:06.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.229277 20363 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40937/jwks.json
12:15:06.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:06.283059 20363 master_runner.cc:387] Master server non-default flags:
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.254:42193
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:06.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data/info.pb
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.254
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/logs
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:06.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:06.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:06.284798 20363 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:06.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:06.286882 20363 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:06.306 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:06.306 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:06.307 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:06.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.307 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.307 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.308 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.308 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.308 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.308 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.308 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.308 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:06.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.308399 20369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:06.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:06.348707 20341 heartbeater.cc:499] Master 127.19.5.124:34641 was elected leader, sending a full tablet report...
12:15:06.382 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:06.382 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:06.382 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:06.382 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.383 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.383 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.383 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.383 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.383 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.383 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:06.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512906385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:06.395 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:15:06.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:15:06.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.479 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:06.480 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:06.480 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:06.480 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:06.480 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:06.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:06.480 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:06.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:06.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:06.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:06.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:06.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:06.481 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:06.524 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:06.525 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:06.525 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:06.525 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.525 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.526 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:06.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512906884 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:06.895 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:15:06.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:15:06.945 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:06.946 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:06.946 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:06.946 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.946 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.946 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:06.946 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.947 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.947 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:06.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:06.947 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:06.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:06.972 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:06.973 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:06.973 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:06.973 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:06.973 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:06.973 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:06.973 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:06.973 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:06.973 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:06.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:06.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:06.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:06.974 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:07.183 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:07.183 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:07.183 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:07.183 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.183 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.184 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.184 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.184 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.184 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:07.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.248 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.265 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:07.265 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:07.265 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:07.266 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:07.266 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:07.266 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:07.266 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:07.266 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:07.266 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:07.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:07.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:07.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:07.267 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:07.385 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:07.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512907384 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:07.385 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:07.385 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:07.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.387 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.387 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:07.395 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:07.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:15:07.410 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:07.410 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:07.410 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:07.411 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.412 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.412 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:07.459 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:07.459 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:07.459 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:07.460 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.460 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.460 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:07.460 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.460 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.460 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:07.460 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.460 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.460 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:07.460 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:07.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.490 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:07.490 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:07.490 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:07.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.491 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:07.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:06.315128 20370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:07.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.504546 20363 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.191s	user 0.506s	sys 0.684s
12:15:07.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.504933 20363 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.192s	user 0.507s	sys 0.684s
12:15:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.506615 20363 server_base.cc:1061] running on GCE node
12:15:07.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.508209 20374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:07.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.509387 20363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.512218 20363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:07.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.513577 20363 hybrid_clock.cc:648] HybridClock initialized: now 1783512907513538 us; error 37 us; skew 500 ppm
12:15:07.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.514397 20363 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:07.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.521859 20363 webserver.cc:533] Webserver started at http://127.19.223.254:45269/ using document root <none> and password file <none>
12:15:07.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.522789 20363 fs_manager.cc:362] Metadata directory not provided
12:15:07.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.523015 20363 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:07.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.523475 20363 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:07.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.527940 20363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data/instance:
12:15:07.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd2de490c4c44404bdb1abc9a18f2ed9"
12:15:07.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:07 on dist-test-slave-vcgh"
12:15:07.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.529212 20363 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal/instance:
12:15:07.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd2de490c4c44404bdb1abc9a18f2ed9"
12:15:07.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:07 on dist-test-slave-vcgh"
12:15:07.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:07.530 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:07.530 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:07.530 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.530 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.530 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.531 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.531 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.531 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:07.533 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:07.534 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:07.534 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:07.534 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.534 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.534 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:07.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:07.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:07.535 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:07.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.537582 20363 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
12:15:07.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.544104 20379 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.545204 20363 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:15:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.545507 20363 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal
12:15:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bd2de490c4c44404bdb1abc9a18f2ed9"
12:15:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:07 on dist-test-slave-vcgh"
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.545815 20363 fs_report.cc:389] FS layout report
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data/data
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:07.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.628773 20363 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:07.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.630453 20363 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:07.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.630832 20363 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:07.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.707156 20363 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.254:42193
12:15:07.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.707232 20430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.254:42193 every 8 connection(s)
12:15:07.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.710022 20363 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/data/info.pb
12:15:07.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.711364 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20363
12:15:07.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.711916 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-0/wal/instance
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.715926 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/logs
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data/info.pb
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.253:37033
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.253
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:07.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:07.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:07.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json with env {}
12:15:07.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.716799 20431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:07.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.730360 20431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } has no permanent_uuid. Determining permanent_uuid...
12:15:07.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.771113 20431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
12:15:07.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.773475 20381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:07.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.777529 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:07.778 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:07.778 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:07.779 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:07.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.779 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.779 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.779 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.779 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.779 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.779 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.779 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:07.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.827071 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 1
12:15:07.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.831597 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:07.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512907885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:07.892 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
12:15:07.892 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:15:07.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.900007 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 2
12:15:07.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:07.904161 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:07.919 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:07.919 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:07.919 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:07.919 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.919 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.919 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.919 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.919 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.919 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.920 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.920 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.920 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:07.959 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:07.959 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:07.959 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:07.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.959 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.959 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.960 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.960 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:07.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:07.960 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:07.960 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:07.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:07.973 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:07.973 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:07.974 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:07.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.974 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:07.985 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:07.985 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:07.985 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:07.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:07.985 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.985 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:07.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.986 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.986 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:07.986 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:07.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:07.995594 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 3
12:15:08.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.000566 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:08.003 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:08.003 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:08.003 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:08.004 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:08.004 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:08.004 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:08.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:08.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:08.004 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:08.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:08.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:08.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:08.004 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:08.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.032137 20433 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:08.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.032770 20433 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:08.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.033300 20433 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:08.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.082247 20433 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:08.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.082598 20433 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.082911 20433 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.083197 20433 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.083485 20433 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:08.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.083696 20433 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40937/jwks.json
12:15:08.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:08.120450 20433 master_runner.cc:387] Master server non-default flags:
12:15:08.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:08.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.253:37033
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data/info.pb
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.253
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/logs
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:08.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:08.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:08.121977 20433 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:08.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:08.123639 20433 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:08.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.134140 20442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:08.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:08.143985 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 4
12:15:08.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.149632 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:08.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:08.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:08.364 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:08.370 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:08.371 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:08.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:08.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:08.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:08.372 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:08.372 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:08.372 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:08.372 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:08.375 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:08.375 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:08.375 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:08.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512908385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:08.399 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:15:08.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:15:08.422 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:08.422 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:08.422 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:08.423 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.423 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.423 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.424 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.424 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.424 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.424 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.424 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.424 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.425 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:08.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:08.449074 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 5
12:15:08.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.456394 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:08.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:08.691 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:08.692 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:08.692 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:08.692 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:08.692 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.692 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.692 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:08.693 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.693 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.693 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:08.693 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.693 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.693 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:08.693 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:08.748 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:08.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512908885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:08.897 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:15:08.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:15:08.916 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:08.916 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:08.917 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:08.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:08.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:08.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:08.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:08.917 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:08.917 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:08.917 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:08.917 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:08.917 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:08.918 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:08.965 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.004168 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 6
12:15:09.009 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:09.009 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:09.010 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:09.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.010 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.010 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.010 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.011 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:09.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.040763 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.253:37033: Network error: Client connection negotiation failed: client connection to 127.19.223.253:37033: connect: Connection refused (error 111)
12:15:09.076 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:09.076 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:09.076 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:09.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.077 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.077 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.077 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:09.098 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:09.099 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:09.099 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:09.100 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.100 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.100 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.100 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.100 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.103 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.103 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:09.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.343 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:09.343 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:09.344 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:09.344 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.344 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.344 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.345 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.345 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.345 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.345 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:09.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512909385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:09.392 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:09.392 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:09.392 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:09.393 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.393 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.393 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:09.393 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.393 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.393 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:09.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:09.394 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:09.397 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:15:09.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:15:09.409 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.409 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.409 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.409 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.410 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.410 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.410 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.410 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.410 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.410 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.410 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.411 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.462 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:09.463 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:09.463 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:09.463 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.463 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.463 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.464 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.464 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.464 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.464 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.464 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.464 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:09.465 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.486 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.486 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.486 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.486 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.487 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.487 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.487 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.487 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.487 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.487 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.505 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.506 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.506 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:08.134572 20443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:09.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.511006 20445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:09.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.513206 20444 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1373 milliseconds
12:15:09.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.514286 20433 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.380s	user 0.527s	sys 0.810s
12:15:09.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.514621 20433 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.380s	user 0.527s	sys 0.810s
12:15:09.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.514882 20433 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:09.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.516296 20433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.519393 20433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.520797 20433 hybrid_clock.cc:648] HybridClock initialized: now 1783512909520838 us; error 135 us; skew 500 ppm
12:15:09.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.521834 20433 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:09.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.530694 20433 webserver.cc:533] Webserver started at http://127.19.223.253:45441/ using document root <none> and password file <none>
12:15:09.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.531909 20433 fs_manager.cc:362] Metadata directory not provided
12:15:09.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.532187 20433 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:09.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.532747 20433 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.538911 20433 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data/instance:
12:15:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "734eeb3a51c74be79995a1fa7bb387b4"
12:15:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:09 on dist-test-slave-vcgh"
12:15:09.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.540355 20433 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal/instance:
12:15:09.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "734eeb3a51c74be79995a1fa7bb387b4"
12:15:09.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:09 on dist-test-slave-vcgh"
12:15:09.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.550194 20433 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
12:15:09.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.557751 20455 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:09.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.559150 20433 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
12:15:09.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.559541 20433 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal
12:15:09.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "734eeb3a51c74be79995a1fa7bb387b4"
12:15:09.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:09 on dist-test-slave-vcgh"
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.559958 20433 fs_report.cc:389] FS layout report
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data/data
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:09.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:09.624 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:09.625 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:09.625 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:09.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:09.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:09.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:09.626 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:09.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:09.626 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:09.626 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:09.626 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:09.626 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:09.626 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:09.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.647042 20433 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:09.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.648999 20433 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:09.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.649520 20433 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:09.665 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.665 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.666 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.666 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.666 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.666 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.667 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.759 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:09.759 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:09.759 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:09.760 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.760 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.760 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.760 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.760 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:09.760 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:09.760 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.760 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.760 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:09.760 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:09.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.769536 20433 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.253:37033
12:15:09.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.769634 20506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.253:37033 every 8 connection(s)
12:15:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.772342 20433 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/data/info.pb
12:15:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.773707 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20433
12:15:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.774183 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-1/wal/instance
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.776845 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/logs
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data/info.pb
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.252:41911
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.252
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json with env {}
12:15:09.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.779665 20507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:09.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.791791 20507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } has no permanent_uuid. Determining permanent_uuid...
12:15:09.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.821343 20507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
12:15:09.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.834872 20507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
12:15:09.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.837308 20458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:09.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.841501 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:09.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512909885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:09.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.891031 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 1
12:15:09.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.896584 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:09.898 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:15:09.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:15:09.923 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:09.923 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:09.923 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:09.923 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.923 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:09.924 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.924 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.924 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:09.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.924 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.924 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:09.924 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:09.925 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.925 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.925 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.926 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:09.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:09.965014 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 2
12:15:09.967 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:09.967 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:09.967 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:09.967 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.967 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.967 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:09.968 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.969 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.969 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:09.969 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.969 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.969 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:09.969 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:09.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:09.973278 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.019 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:10.019 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:10.019 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:10.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:10.020 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:10.020 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:10.020 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:10.020 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:10.020 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:10.020 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:10.020 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:10.020 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:10.020 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:10.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.064739 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 3
12:15:10.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.070365 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.101240 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } attempt: 7
12:15:10.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.112718 20431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
12:15:10.118 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:10.118 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:10.118 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:10.119 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.119 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.119 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.119 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.119 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.119 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.119 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.119 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.119 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:10.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.119737 20509 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:10.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.120291 20509 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:10.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.120800 20509 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:10.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.132562 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.154834 20509 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.155102 20509 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.155303 20509 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.155537 20509 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.155733 20509 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:10.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.155918 20509 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40937/jwks.json
12:15:10.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:10.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.190972 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 1
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.194070 20509 master_runner.cc:387] Master server non-default flags:
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.252:41911
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40937/jwks.json
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data/info.pb
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.252
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/logs
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.195030 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.195614 20509 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:10.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.197343 20509 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.208989 20521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.213775 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 4
12:15:10.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.218779 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.249 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:10.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.276444 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 2
12:15:10.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.284386 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.370201 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 3
12:15:10.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.378427 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512910385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:10.394 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:10.396 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:15:10.458 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:10.458 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:10.459 [DEBUG - pool-204-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:10.459 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.459 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.459 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.459 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.459 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.459 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.459 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:10.460 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26993), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [229ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [238ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [255ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [255ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [307ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [339ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [339ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [410ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [411ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [425ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [443ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [470ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [470ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [821ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [823ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1320ms] refreshing cache from master, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3840ms] refreshing cache from master, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3841ms] too many traces: truncated at 100 traces, deferred=Deferred@1097031115(state=PENDING, result=null, callback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402), errback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402)))
12:15:10.461 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:10.462 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26993), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [229ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [238ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [255ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [255ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [307ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [339ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [339ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [410ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [411ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [425ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [443ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [470ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [470ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [821ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [823ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1320ms] refreshing cache from master, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3840ms] refreshing cache from master, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3841ms] too many traces: truncated at 100 traces, deferred=Deferred@1097031115(state=PENDING, result=null, callback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402), errback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:10.462 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
12:15:10.464 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:15:10.465 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:10.467 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26993), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [229ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [238ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [255ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [255ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [307ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [339ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [339ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [410ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [411ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [424ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [425ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [425ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [443ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [470ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [470ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [521ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [821ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [822ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [823ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1320ms] refreshing cache from master, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3840ms] refreshing cache from master, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3841ms] too many traces: truncated at 100 traces, deferred=Deferred@1097031115(state=PENDING, result=null, callback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402), errback=(continuation of Deferred@1774000855 after retry RPC after error@1907257508) -> (continuation of Deferred@2046731777 after retry RPC after error@573055472) -> (continuation of Deferred@591588544 after retry RPC after error@560698204) -> (continuation of Deferred@757725150 after retry RPC after error@1315791914) -> (continuation of Deferred@2055058891 after retry RPC after error@133245099) -> (continuation of Deferred@1703192716 after retry RPC after error@1080941602) -> (continuation of Deferred@1470757385 after retry RPC after error@1494426663) -> (continuation of Deferred@429078337 after retry RPC after error@934372509) -> (continuation of Deferred@793815504 after retry RPC after error@1864536577) -> (continuation of Deferred@1863031195 after retry RPC after error@1394777451) -> (continuation of Deferred@2031526134 after retry RPC after error@39814991) -> (continuation of Deferred@824906206 after retry RPC after error@1990531925) -> (continuation of Deferred@980948071 after retry RPC after error@1147378072) -> (continuation of Deferred@766493995 after retry RPC after error@1938693240) -> (continuation of Deferred@154137922 after retry RPC after error@1364726438) -> (continuation of Deferred@34407227 after retry RPC after error@31695582) -> (continuation of Deferred@2005975621 after retry RPC after error@1724658483) -> (continuation of Deferred@204664842 after retry RPC after error@282805760) -> (continuation of Deferred@1630026932 after retry RPC after error@1719328265) -> (continuation of Deferred@2111033452 after retry RPC after error@930243216) -> (continuation of Deferred@387917142 after retry RPC after error@665140010) -> (continuation of Deferred@1150738178 after retry RPC after error@1624527842) -> (continuation of Deferred@235929403 after retry RPC after error@8255931) -> (continuation of Deferred@1927366777 after retry RPC after error@812142212) -> (continuation of Deferred@1097828757 after retry RPC after error@783290402)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:10.468 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:10.469 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
12:15:10.469 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:15:10.470 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:15:10.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.518251 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 5
12:15:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.518824 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 4
12:15:10.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.526110 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.527081 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.653 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:10.653 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:10.653 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:10.654 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:10.654 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:10.654 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:10.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:10.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:10.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:10.655 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:10.655 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:10.655 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:10.655 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:10.673 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:10.674 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:10.674 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:10.674 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.674 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.674 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.675 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:10.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:10.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:10.810513 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 5
12:15:10.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.816231 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:10.886 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:10.886 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:10.887 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:10.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:10.888 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.888 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:10.888 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.889 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512910885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:10.889 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:10.889 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:10.901 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=15 ms, finalizationTime=1 ms).
12:15:10.902 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:15:10.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:10.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:10.922 [DEBUG - pool-202-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:10.922 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.923 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.923 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.923 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.923 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:10.923 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:10.923 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.923 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.923 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:10.923 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:10.924 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27486), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [154ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [167ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [197ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [300ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [312ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [323ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [562ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1141ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2843ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@474832063(state=PENDING, result=null, callback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053), errback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053)))
12:15:10.925 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:10.925 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27486), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [154ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [167ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [197ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [300ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [312ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [323ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [562ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1141ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2843ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@474832063(state=PENDING, result=null, callback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053), errback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:10.925 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
12:15:10.928 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:15:10.930 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=27486), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [154ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [167ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [197ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [298ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [300ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [312ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [312ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [322ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [323ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [443ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [561ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [562ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [623ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1141ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2843ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2843ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@474832063(state=PENDING, result=null, callback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053), errback=(continuation of Deferred@1023879061 after retry RPC after error@682710163) -> (continuation of Deferred@94181979 after retry RPC after error@1933772531) -> (continuation of Deferred@2004659329 after retry RPC after error@1431006001) -> (continuation of Deferred@946469889 after retry RPC after error@1408631137) -> (continuation of Deferred@1107081018 after retry RPC after error@1331711703) -> (continuation of Deferred@941501134 after retry RPC after error@1526782373) -> (continuation of Deferred@2145509528 after retry RPC after error@842665797) -> (continuation of Deferred@2075855766 after retry RPC after error@648755381) -> (continuation of Deferred@1446963672 after retry RPC after error@874288253) -> (continuation of Deferred@391700179 after retry RPC after error@1758011933) -> (continuation of Deferred@1234724597 after retry RPC after error@427277511) -> (continuation of Deferred@1208502140 after retry RPC after error@1768971690) -> (continuation of Deferred@1674912191 after retry RPC after error@1197484166) -> (continuation of Deferred@1297720497 after retry RPC after error@649014717) -> (continuation of Deferred@1815951374 after retry RPC after error@719264023) -> (continuation of Deferred@715345105 after retry RPC after error@1975406333) -> (continuation of Deferred@1883694348 after retry RPC after error@579030450) -> (continuation of Deferred@309741815 after retry RPC after error@364389858) -> (continuation of Deferred@1376898268 after retry RPC after error@1791485425) -> (continuation of Deferred@1247164846 after retry RPC after error@504730163) -> (continuation of Deferred@1111415297 after retry RPC after error@386090970) -> (continuation of Deferred@1818466269 after retry RPC after error@1591018600) -> (continuation of Deferred@1779376993 after retry RPC after error@1732220013) -> (continuation of Deferred@387066408 after retry RPC after error@1636997862) -> (continuation of Deferred@1914022302 after retry RPC after error@1771231053)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:10.931 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:15:10.932 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:10.932 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
12:15:10.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:10.975 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:10.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:10.976 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:10.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:10.976 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.976 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.976 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:10.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:10.977 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:11.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.073578 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 6
12:15:11.085 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:11.085 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:11.086 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:11.086 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.086 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.086 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.086 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.086 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.087 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.087 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.093362 20507 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:11.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:11.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.368712 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 6
12:15:11.373 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:11.374 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:11.374 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:11.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.374 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.374 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.374 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.375 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.375 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.375 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.375 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:11.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.376003 20431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.223.252:41911: Network error: Client connection negotiation failed: client connection to 127.19.223.252:41911: connect: Connection refused (error 111)
12:15:11.387 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512911386 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:11.400 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:15:11.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:15:11.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:11.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:10.210312 20522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:11.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.495999 20524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:11.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.498320 20523 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1284 milliseconds
12:15:11.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.498440 20509 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:11.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.499779 20509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:11.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.502375 20509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:11.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.503752 20509 hybrid_clock.cc:648] HybridClock initialized: now 1783512911503721 us; error 30 us; skew 500 ppm
12:15:11.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.504616 20509 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:11.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.510584 20509 webserver.cc:533] Webserver started at http://127.19.223.252:41407/ using document root <none> and password file <none>
12:15:11.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.511502 20509 fs_manager.cc:362] Metadata directory not provided
12:15:11.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.511680 20509 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:11.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.512058 20509 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:11.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.516270 20509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data/instance:
12:15:11.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "093bf347b92e4ef5bf594787f4da6143"
12:15:11.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:11 on dist-test-slave-vcgh"
12:15:11.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.517374 20509 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal/instance:
12:15:11.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "093bf347b92e4ef5bf594787f4da6143"
12:15:11.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:11 on dist-test-slave-vcgh"
12:15:11.519 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:11.520 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:11.520 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:11.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:11.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:11.520 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:11.520 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:11.520 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:11.520 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:11.520 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:11.520 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:11.520 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:11.520 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:11.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.525549 20509 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
12:15:11.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.531352 20537 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:11.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.532343 20509 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
12:15:11.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.532656 20509 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal
12:15:11.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "093bf347b92e4ef5bf594787f4da6143"
12:15:11.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:11 on dist-test-slave-vcgh"
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.533051 20509 fs_report.cc:389] FS layout report
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data/data
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:11.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.596386 20509 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.597960 20509 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:11.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.598348 20509 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:11.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.670442 20509 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.252:41911
12:15:11.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.670519 20588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.252:41911 every 8 connection(s)
12:15:11.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.673717 20509 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/data/info.pb
12:15:11.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.679767 20589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:11.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.682116 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20509
12:15:11.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.682461 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/master-2/wal/instance
12:15:11.694 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:11.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.693132 20589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } has no permanent_uuid. Determining permanent_uuid...
12:15:11.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.735299 20589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } has no permanent_uuid. Determining permanent_uuid...
12:15:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.749161 20589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } has no permanent_uuid. Determining permanent_uuid...
12:15:11.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.770676 20589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: Bootstrap starting.
12:15:11.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.777479 20589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: Neither blocks nor log segments found. Creating new log.
12:15:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.779470 20589 log.cc:826] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: Log is configured to *not* fsync() on all Append() calls
12:15:11.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.785367 20589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: No bootstrap required, opened a new log
12:15:11.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.806233 20589 raft_consensus.cc:359] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:11.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.806849 20589 raft_consensus.cc:385] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:11.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.807073 20589 raft_consensus.cc:740] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 093bf347b92e4ef5bf594787f4da6143, State: Initialized, Role: FOLLOWER
12:15:11.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.807799 20589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:11.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.810293 20600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:11.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.811014 20600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: This master's current role is: FOLLOWER
12:15:11.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.812124 20589 sys_catalog.cc:565] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: configured and running, proceeding with master startup.
12:15:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.842286 20612 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.842543 20612 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:11.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:11.853267 20543 tablet.cc:2406] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:11.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.838655 20509 master_runner.cc:187] Error getting master registration for 127.19.223.254:42193: OK, instance_id { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" instance_seqno: 1783512907684833 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:11.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.870262 20509 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:11.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512911885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:11.893 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:15:11.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.895136 20600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:11.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.895617 20600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:11.896 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:15:11.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:11.898054 20600 leader_election.cc:290] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd2de490c4c44404bdb1abc9a18f2ed9 (127.19.223.254:42193), 734eeb3a51c74be79995a1fa7bb387b4 (127.19.223.253:37033)
12:15:11.901 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:11.902 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:11.902 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:11.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.903 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.903 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.903 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:11.903 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.903 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.903 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:11.903 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.903 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:11.903 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:11.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:11.969 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:11.969 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:11.969 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:11.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.969 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.969 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:11.970 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.970 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.970 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:11.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.970 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.970 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:11.970 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:12.013 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:12.013 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:12.013 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:12.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.015 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.015 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.015 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:12.119 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:12.120 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:12.120 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:12.120 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:12.120 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:12.120 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:12.120 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:12.120 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:12.120 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:12.120 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:12.120 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:12.120 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:12.121 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:12.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.153820 20507 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 7
12:15:12.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.175076 20507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: Bootstrap starting.
12:15:12.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.180855 20507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: Neither blocks nor log segments found. Creating new log.
12:15:12.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.183367 20507 log.cc:826] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: Log is configured to *not* fsync() on all Append() calls
12:15:12.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.187994 20507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: No bootstrap required, opened a new log
12:15:12.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:12.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.209772 20507 raft_consensus.cc:359] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.210433 20507 raft_consensus.cc:385] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.210700 20507 raft_consensus.cc:740] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 734eeb3a51c74be79995a1fa7bb387b4, State: Initialized, Role: FOLLOWER
12:15:12.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.211474 20507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.214577 20616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.216352 20616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.216478 20507 sys_catalog.cc:565] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: configured and running, proceeding with master startup.
12:15:12.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.217041 20482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093bf347b92e4ef5bf594787f4da6143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "734eeb3a51c74be79995a1fa7bb387b4" is_pre_election: true
12:15:12.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.218837 20482 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 093bf347b92e4ef5bf594787f4da6143 in term 0.
12:15:12.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.221119 20539 leader_election.cc:304] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 093bf347b92e4ef5bf594787f4da6143, 734eeb3a51c74be79995a1fa7bb387b4; no voters: 
12:15:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.222074 20600 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.222416 20600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.222759 20600 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 0 FOLLOWER]: Advancing to term 1
12:15:12.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.233755 20600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.238721 20600 leader_election.cc:290] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [CANDIDATE]: Term 1 election: Requested vote from peers bd2de490c4c44404bdb1abc9a18f2ed9 (127.19.223.254:42193), 734eeb3a51c74be79995a1fa7bb387b4 (127.19.223.253:37033)
12:15:12.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.241225 20482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093bf347b92e4ef5bf594787f4da6143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "734eeb3a51c74be79995a1fa7bb387b4"
12:15:12.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.241775 20482 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 0 FOLLOWER]: Advancing to term 1
12:15:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.257894 20482 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 093bf347b92e4ef5bf594787f4da6143 in term 1.
12:15:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.260327 20539 leader_election.cc:304] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 093bf347b92e4ef5bf594787f4da6143, 734eeb3a51c74be79995a1fa7bb387b4; no voters: 
12:15:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.261217 20600 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 1 FOLLOWER]: Leader election won for term 1
12:15:12.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.274854 20600 raft_consensus.cc:697] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [term 1 LEADER]: Becoming Leader. State: Replica: 093bf347b92e4ef5bf594787f4da6143, State: Running, Role: LEADER
12:15:12.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.277216 20600 consensus_queue.cc:237] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.284 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:12.284 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:12.284 [DEBUG - pool-198-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:12.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.286 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.286 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.286 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.286 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:12.287 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28867), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [128ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [132ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [550ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [552ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [605ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [606ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [610ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [610ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [695ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [721ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [741ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [742ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [784ms] refreshing cache from master, [784ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [789ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [863ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [922ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [924ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1542ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3520ms] refreshing cache from master, [3520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3523ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4300ms] refreshing cache from master, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4301ms] too many traces: truncated at 100 traces, deferred=Deferred@591738690(state=PENDING, result=null, callback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872), errback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872)))
12:15:12.288 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:12.288 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28867), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [128ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [132ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [550ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [552ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [605ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [606ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [610ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [610ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [695ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [721ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [741ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [742ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [784ms] refreshing cache from master, [784ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [789ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [863ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [922ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [924ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1542ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3520ms] refreshing cache from master, [3520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3523ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4300ms] refreshing cache from master, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4301ms] too many traces: truncated at 100 traces, deferred=Deferred@591738690(state=PENDING, result=null, callback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872), errback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.61:39401
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.288 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
12:15:12.291 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:15:12.293 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28867), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [128ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [132ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [550ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [552ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [605ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [606ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [610ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [610ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [662ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [694ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [695ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [700ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [720ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [721ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [721ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [741ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [742ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [742ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [784ms] refreshing cache from master, [784ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [785ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [789ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [789ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [863ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [922ms] refreshing cache from master, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [922ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [923ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [923ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [924ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [924ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1181ms] refreshing cache from master, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1381ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1540ms] refreshing cache from master, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1541ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1542ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3520ms] refreshing cache from master, [3520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3522ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3523ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4300ms] refreshing cache from master, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4301ms] too many traces: truncated at 100 traces, deferred=Deferred@591738690(state=PENDING, result=null, callback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872), errback=(continuation of Deferred@821640404 after retry RPC after error@1560301222) -> (continuation of Deferred@668686243 after retry RPC after error@766417725) -> (continuation of Deferred@1422400960 after retry RPC after error@190979201) -> (continuation of Deferred@1987650561 after retry RPC after error@794246784) -> (continuation of Deferred@996479159 after retry RPC after error@544773454) -> (continuation of Deferred@522118252 after retry RPC after error@162232881) -> (continuation of Deferred@450376475 after retry RPC after error@2129532907) -> (continuation of Deferred@373006814 after retry RPC after error@1142111194) -> (continuation of Deferred@520652968 after retry RPC after error@290948589) -> (continuation of Deferred@1512698696 after retry RPC after error@129617468) -> (continuation of Deferred@1546607531 after retry RPC after error@1903871278) -> (continuation of Deferred@1683803130 after retry RPC after error@769470819) -> (continuation of Deferred@185193840 after retry RPC after error@754786954) -> (continuation of Deferred@788283380 after retry RPC after error@1794000225) -> (continuation of Deferred@797556505 after retry RPC after error@1789210896) -> (continuation of Deferred@627679279 after retry RPC after error@1035222190) -> (continuation of Deferred@1596403062 after retry RPC after error@474593843) -> (continuation of Deferred@1959332173 after retry RPC after error@1753483830) -> (continuation of Deferred@246335181 after retry RPC after error@1600613641) -> (continuation of Deferred@1666749641 after retry RPC after error@726005550) -> (continuation of Deferred@1394988069 after retry RPC after error@936309869) -> (continuation of Deferred@278380673 after retry RPC after error@351254842) -> (continuation of Deferred@1763103614 after retry RPC after error@700137389) -> (continuation of Deferred@126247379 after retry RPC after error@1850293872)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.61:39401
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.294 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:12.294 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
12:15:12.295 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:15:12.298 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:12.298 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:12.299 [DEBUG - pool-200-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:12.300 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.300 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.300 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:12.300 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:12.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.301 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:12.301 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:12.302 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28874), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [133ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [275ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [356ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [356ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [418ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [435ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [436ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [436ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [603ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [604ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1003ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1763ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5521ms] too many traces: truncated at 100 traces, deferred=Deferred@1239897723(state=PENDING, result=null, callback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391), errback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391)))
12:15:12.303 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:12.303 [WARN - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28874), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [133ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [275ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [356ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [356ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [418ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [435ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [436ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [436ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [603ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [604ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1003ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1763ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5521ms] too many traces: truncated at 100 traces, deferred=Deferred@1239897723(state=PENDING, result=null, callback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391), errback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.303 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:15:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.304723 20624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093bf347b92e4ef5bf594787f4da6143. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.306715 20624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: This master's current role is: LEADER
12:15:12.307 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
12:15:12.310 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28874), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [133ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [275ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [294ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [356ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [356ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [417ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [418ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [435ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [435ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [436ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [436ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [603ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [604ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [604ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [782ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [782ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1000ms] refreshing cache from master, [1000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1003ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1761ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1763ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2720ms] refreshing cache from master, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2722ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2723ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2723ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5520ms] refreshing cache from master, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5521ms] too many traces: truncated at 100 traces, deferred=Deferred@1239897723(state=PENDING, result=null, callback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391), errback=(continuation of Deferred@594506582 after retry RPC after error@1408210887) -> (continuation of Deferred@1028075404 after retry RPC after error@1314972369) -> (continuation of Deferred@382586248 after retry RPC after error@959652153) -> (continuation of Deferred@1032606428 after retry RPC after error@1949522390) -> (continuation of Deferred@208304981 after retry RPC after error@753973512) -> (continuation of Deferred@1932858616 after retry RPC after error@489037473) -> (continuation of Deferred@1112112771 after retry RPC after error@1809360699) -> (continuation of Deferred@806481004 after retry RPC after error@502214617) -> (continuation of Deferred@349960065 after retry RPC after error@982809438) -> (continuation of Deferred@89752300 after retry RPC after error@1638720633) -> (continuation of Deferred@713056306 after retry RPC after error@861384887) -> (continuation of Deferred@2052070099 after retry RPC after error@2086254284) -> (continuation of Deferred@1433524357 after retry RPC after error@1529677972) -> (continuation of Deferred@558962592 after retry RPC after error@277818000) -> (continuation of Deferred@1273064948 after retry RPC after error@2017179060) -> (continuation of Deferred@1367228676 after retry RPC after error@952904209) -> (continuation of Deferred@2021817905 after retry RPC after error@1571943040) -> (continuation of Deferred@2128936531 after retry RPC after error@664919868) -> (continuation of Deferred@1287216655 after retry RPC after error@516849898) -> (continuation of Deferred@1191310086 after retry RPC after error@1852869861) -> (continuation of Deferred@1757412866 after retry RPC after error@35449391)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.312 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:15:12.313 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
12:15:12.313 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
12:15:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.328467 20630 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:15:12.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:12.339115 20628 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:12.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:12.339777 20628 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:12.344 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:12.345 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:12.345 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:12.345 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.345 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.345 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.346 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.346 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.346 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.346 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:12.361 [DEBUG - pool-174-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.16.194.124:36205, [13ms] received response from server master-127.16.194.124:36205: OK, deferred=null) with no deferred attached!
12:15:12.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.363332 20630 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:15:12.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512912385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:12.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.323947 20433 master_runner.cc:187] Error getting master registration for 127.19.223.254:42193: OK, instance_id { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" instance_seqno: 1783512907684833 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:12.393 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:12.395 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:15:12.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.392668 20433 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:12.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.406251 20482 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [term 1 FOLLOWER]: Refusing update from remote peer 093bf347b92e4ef5bf594787f4da6143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:12.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.407831 20624 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:12.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:12.408414 20461 tablet.cc:2406] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:12.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.409407 20431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } attempt: 7
12:15:12.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.435909 20431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: Bootstrap starting.
12:15:12.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.443337 20431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: Neither blocks nor log segments found. Creating new log.
12:15:12.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.462607 20431 log.cc:826] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: Log is configured to *not* fsync() on all Append() calls
12:15:12.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:12.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.467872 20632 mvcc.cc:204] Tried to move back new op lower bound from 7305268889200160768 to 7305268888751480832. Current Snapshot: MvccSnapshot[applied={T|T < 7305268889200160768}]
12:15:12.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.470306 20616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093bf347b92e4ef5bf594787f4da6143. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.471005 20616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.478139 20600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.478884 20600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: This master's current role is: LEADER
12:15:12.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.481608 20431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: No bootstrap required, opened a new log
12:15:12.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.483038 20630 catalog_manager.cc:1383] Generated new cluster ID: fbcbb06fdde84844a0c8d7b211a4af80
12:15:12.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.483320 20630 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:15:12.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.497596 20616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.498247 20616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.520927 20630 catalog_manager.cc:1406] Generated new certificate authority record
12:15:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.522917 20630 catalog_manager.cc:1540] Loading token signing keys...
12:15:12.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:12.529 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:12.530 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:12.530 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:12.530 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:12.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:12.530 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:12.530 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:12.530 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:12.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:12.530 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:12.530 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:12.530 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:12.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.541884 20431 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.542892 20431 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.543291 20431 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd2de490c4c44404bdb1abc9a18f2ed9, State: Initialized, Role: FOLLOWER
12:15:12.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.544538 20431 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } }
12:15:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.549142 20630 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: Generated new TSK 0
12:15:12.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.551942 20630 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:15:12.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.561865 20431 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: configured and running, proceeding with master startup.
12:15:12.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.562390 20404 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [term 0 FOLLOWER]: Advancing to term 1
12:15:12.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.564520 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093bf347b92e4ef5bf594787f4da6143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" is_pre_election: true
12:15:12.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.564070 20405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "093bf347b92e4ef5bf594787f4da6143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9"
12:15:12.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.559054 20640 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.572 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:12.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.572827 20404 raft_consensus.cc:1275] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [term 1 FOLLOWER]: Refusing update from remote peer 093bf347b92e4ef5bf594787f4da6143: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:12.573 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:12.573 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:12.573 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:12.573 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:12.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:12.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:12.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:12.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:12.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:12.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:12.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:12.574 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:12.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.576484 20624 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.578691 20640 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.584096 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/logs
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data/info.pb
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.193:0
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.193
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.193
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.639226 20640 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 093bf347b92e4ef5bf594787f4da6143. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.641003 20640 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.642515 20646 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.643914 20646 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9 [sys.catalog]: This master's current role is: FOLLOWER
12:15:12.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:12.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:12.778872 20658 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:15:12.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.799 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.800 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.800 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.800 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.800 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.800 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.800 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.800 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.801 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.801 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.821 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:12.822 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:12.822 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:12.822 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.822 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.822 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.823 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.823 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.823 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:12.825 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:12.825 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:12.826 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:12.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.826 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.826 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:12.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:12.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:12.827 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:12.879 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.880 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.880 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.883 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.884 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.884 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.884 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.884 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.885 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29317), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [40ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [49ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [258ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [338ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [423ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [424ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [563ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1004ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1983ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3163ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1969993830(state=PENDING, result=null, callback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898), errback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898)))
12:15:12.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512912885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:12.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.886 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.886 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.886 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.886 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.886 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.886 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.886 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.886 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29317), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [40ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [49ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [258ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [338ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [423ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [424ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [563ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1004ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1983ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3163ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1969993830(state=PENDING, result=null, callback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898), errback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29317), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [40ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [49ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [258ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [338ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [423ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [424ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [563ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1004ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1983ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3163ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1969993830(state=PENDING, result=null, callback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898), errback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.887 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.891 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29317), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [40ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [49ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [258ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [338ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [423ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [424ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [563ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1004ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1983ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3163ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1969993830(state=PENDING, result=null, callback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898), errback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29317), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [28ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [40ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [49ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [255ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [256ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [258ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [260ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [260ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [337ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [338ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [343ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [343ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [362ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [363ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [422ms] refreshing cache from master, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [423ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [424ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [424ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [503ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [503ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [561ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [563ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [563ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1003ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1004ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1004ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1981ms] refreshing cache from master, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1982ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1983ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1983ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3161ms] refreshing cache from master, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3163ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3163ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5721ms] refreshing cache from master, [5721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5722ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5722ms] too many traces: truncated at 100 traces, deferred=Deferred@1969993830(state=PENDING, result=null, callback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898), errback=(continuation of Deferred@1140677679 after retry RPC after error@1868791448) -> (continuation of Deferred@325782509 after retry RPC after error@1005271406) -> (continuation of Deferred@316544536 after retry RPC after error@1715285349) -> (continuation of Deferred@767714860 after retry RPC after error@1325402803) -> (continuation of Deferred@755805085 after retry RPC after error@576056668) -> (continuation of Deferred@479726652 after retry RPC after error@1392695438) -> (continuation of Deferred@463126832 after retry RPC after error@380166162) -> (continuation of Deferred@1242425111 after retry RPC after error@261001328) -> (continuation of Deferred@1112560624 after retry RPC after error@321491928) -> (continuation of Deferred@918158325 after retry RPC after error@1297084482) -> (continuation of Deferred@230745544 after retry RPC after error@1378353403) -> (continuation of Deferred@725040920 after retry RPC after error@432543708) -> (continuation of Deferred@321675144 after retry RPC after error@17935054) -> (continuation of Deferred@323787275 after retry RPC after error@1248004425) -> (continuation of Deferred@1002626962 after retry RPC after error@923358718) -> (continuation of Deferred@1080167894 after retry RPC after error@312049106) -> (continuation of Deferred@1057623644 after retry RPC after error@1121000166) -> (continuation of Deferred@302887895 after retry RPC after error@1268984745) -> (continuation of Deferred@607429743 after retry RPC after error@1853393957) -> (continuation of Deferred@294918454 after retry RPC after error@1136166606) -> (continuation of Deferred@1110332682 after retry RPC after error@1755177166) -> (continuation of Deferred@1500580162 after retry RPC after error@1593342548) -> (continuation of Deferred@1850667652 after retry RPC after error@1775432723) -> (continuation of Deferred@943250290 after retry RPC after error@630144251) -> (continuation of Deferred@1011626012 after retry RPC after error@1119889898)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:12.892 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:12.896 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:12.897 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:15:12.899 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.899 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.899 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.900 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.900 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.900 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.900 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.900 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.900 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.901 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.901 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.901 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.901 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.919 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.919 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.919 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.919 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.919 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.919 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.920 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.920 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.939 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.939 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.939 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.939 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.939 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.939 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.939 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.940 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.940 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.940 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.940 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.940 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.960 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:12.960 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:12.960 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:12.960 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.960 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.960 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:12.960 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.961 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.961 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:12.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:12.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:12.964 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:12.989 [DEBUG - pool-182-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [12ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:12.989 [DEBUG - pool-182-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [20ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:12.989 [DEBUG - pool-182-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [11ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:12.989 [DEBUG - pool-182-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [20ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.000 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:13.000 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:13.000 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:13.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.002 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:13.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.056242 20642 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.056941 20642 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.057682 20642 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:13.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:13.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:13.060 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:13.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.061 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.061 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.061 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.061 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.061 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:13.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.069370 20624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "093bf347b92e4ef5bf594787f4da6143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd2de490c4c44404bdb1abc9a18f2ed9" member_type: VOTER last_known_addr { host: "127.19.223.254" port: 42193 } } peers { permanent_uuid: "734eeb3a51c74be79995a1fa7bb387b4" member_type: VOTER last_known_addr { host: "127.19.223.253" port: 37033 } } peers { permanent_uuid: "093bf347b92e4ef5bf594787f4da6143" member_type: VOTER last_known_addr { host: "127.19.223.252" port: 41911 } } }
12:15:13.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.070255 20624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143 [sys.catalog]: This master's current role is: LEADER
12:15:13.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.115978 20642 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.117261 20642 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.223.193
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [15ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [77ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30006), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [74ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [74ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [75ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [72ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [18ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.118 [DEBUG - pool-180-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] sending RPC to server master-127.17.135.252:38447, [72ms] received response from server master-127.17.135.252:38447: OK, deferred=null) with no deferred attached!
12:15:13.119 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:13.119 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:13.119 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:13.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.119 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.119 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.119 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.120 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.120 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.120 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.120 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.120 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.120 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.121 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.120 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.122 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:13.124 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.125 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.125 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.125 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.180470 20642 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.193:0
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data/info.pb
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.193
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.193
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/logs
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.182160 20642 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:13.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.184237 20642 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:13.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:13.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.219923 20668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:13.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.347014 20628 catalog_manager.cc:1295] Loaded cluster ID: fbcbb06fdde84844a0c8d7b211a4af80
12:15:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.353871 20628 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: loading cluster ID for follower catalog manager: success
12:15:13.359 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:13.360 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:13.360 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:13.360 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.360 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.360 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.361 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:13.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.375104 20628 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: acquiring CA information for follower catalog manager: success
12:15:13.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512913384 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:13.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.397708 20628 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 734eeb3a51c74be79995a1fa7bb387b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:13.398 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:15:13.400 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
12:15:13.424 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.425 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.425 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.425 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.425 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.425 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.426 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.426 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.426 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.430 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:13.430 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:13.430 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:13.430 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:13.430 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:13.430 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:13.430 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:13.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:13.431 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:13.431 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:13.431 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:13.431 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:13.431 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:13.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:13.499 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:13.499 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:13.500 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:13.500 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.500 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.500 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:13.500 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.500 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.500 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:13.500 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.500 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:13.500 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:13.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.566 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.566 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.567 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.567 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.567 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.567 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.567 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.567 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.567 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.567 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.568 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.583 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:13.583 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:13.584 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:13.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:13.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:13.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:13.585 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:13.585 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:13.585 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:13.585 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:13.585 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:13.585 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:13.585 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:13.645 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:13.645 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:13.645 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:13.645 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:13.646 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:13.646 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:13.646 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:13.646 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:13.646 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:13.646 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:13.646 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:13.646 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:13.646 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:13.678 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.678 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.679 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.679 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.679 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.679 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.680 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.680 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.680 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.680 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.680 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.680 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.680 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:13.804 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.804 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.805 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.805367 20658 catalog_manager.cc:1295] Loaded cluster ID: fbcbb06fdde84844a0c8d7b211a4af80
12:15:13.805 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.805 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.805 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.805657 20658 catalog_manager.cc:1588] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: loading cluster ID for follower catalog manager: success
12:15:13.806 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.806 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.806 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.812767 20658 catalog_manager.cc:1610] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: acquiring CA information for follower catalog manager: success
12:15:13.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:13.836645 20658 catalog_manager.cc:1638] T 00000000000000000000000000000000 P bd2de490c4c44404bdb1abc9a18f2ed9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:13.885 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512913885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:13.897 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:15:13.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
12:15:13.904 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:13.905 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:13.905 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:13.905 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.905 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.905 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:13.906 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.906 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.906 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:13.906 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.906 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:13.906 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:13.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:14.132 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:14.132 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:14.132 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:14.133 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.133 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.133 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.134 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.134 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.134 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.134 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.134 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.134 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.134 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:14.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:14.279 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:14.279 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:14.280 [DEBUG - pool-196-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:14.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:14.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:14.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:14.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:14.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:14.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:14.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:14.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:14.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:14.281 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:14.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:14.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:14.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:14.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.293 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.294 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.294 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.294 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:14.301 [DEBUG - pool-174-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30002), Traces: [0ms] sending RPC to server master-127.16.194.124:36205, [5ms] received response from server master-127.16.194.124:36205: OK, deferred=null) with no deferred attached!
12:15:14.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:14.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:14.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:14.303 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:14.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:14.303 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:14.304 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:14.304 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:14.304 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:14.304 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:14.304 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:14.304 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:14.304 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:14.369 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:14.370 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:14.370 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:14.370 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.370 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.370 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.370 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.370 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.370 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.371 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:14.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512914385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:14.399 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:15:14.401 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
12:15:14.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:14.625 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:14.625 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:14.626 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:14.626 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.626 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.626 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.627 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:14.664 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:14.665 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:14.665 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:14.665 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.666 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:14.666 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.666 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.666 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:14.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:14.667 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:14.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:14.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512914885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:14.893 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:14.895 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
12:15:14.913 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:14.913 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:14.913 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:14.914 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.914 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:14.914 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.914 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.914 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:14.914 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.914 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.915 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:14.915 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:14.956 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:14.956 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:14.956 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:14.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:14.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:14.961 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.961 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:14.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:14.961 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:14.961 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:14.961 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:14.962 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:14.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:14.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:14.962 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:14.962 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:14.962 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:14.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:14.963 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:14.963 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:14.963 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:14.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.033 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:15.033 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:15.034 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:15.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:15.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:15.034 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:15.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:15.034 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:15.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:15.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:15.034 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:15.034 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:15.034 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:15.068 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:15:15.070 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:15:15.071 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:15:15.071 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:15:15.074 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
12:15:15.075 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:15.076 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
12:15:15.076 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:15:15.076 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
12:15:15.077 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:15.077 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:15:15.078 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:15:15.080 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
12:15:15.080 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
12:15:15.081 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1225e897
12:15:15.081 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:15.084 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:15.084 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:15:15.085 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
12:15:15.086 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:15:15.086 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:15:15.086 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
12:15:15.086 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:14.600929 20667 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 20642
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:15.087193 20667 kernel_stack_watchdog.cc:198] Thread 20642 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 375ms:
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:15.083858 20670 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1861 milliseconds
12:15:15.086 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
12:15:15.088 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:15:15.088 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
12:15:15.088 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:15.088 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
12:15:15.089 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:15:15.089 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:15:15.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:13.220608 20669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:15.090 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:15:15.090 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:15:15.091 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:15:15.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
12:15:15.092 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
12:15:15.093 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ae7da83
12:15:15.093 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:15.093 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:15.095 [INFO - Thread-43] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:15:15.095 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:15:15.095 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:15:15.095 [DEBUG - Thread-43] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:15:15.095 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:15.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:15.096460 20642 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.873s	user 0.005s	sys 0.004s
12:15:15.097 [INFO - Thread-43] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:15:15.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:15.096923 20642 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.873s	user 0.005s	sys 0.004s
12:15:15.097 [INFO - Thread-43] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:15:15.098 [DEBUG - Thread-43] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:15.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:15:15.100 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:15:15.100 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:15:15.101 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:15:15.101 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
12:15:15.101 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
12:15:15.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e4c1cd4
12:15:15.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:15.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:15.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:15:15.103 [INFO - Thread-43] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:15.105 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:15:15.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:15.105373 20672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:15.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.106055 20642 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:15.107 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@64368cc7
12:15:15.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.107563 20642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:15.110 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2bb732b2
12:15:15.116 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a4ea2c5
12:15:15.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.125416 20642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:15.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
12:15:15.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
12:15:15.127 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@79de4093
12:15:15.127 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:15.127 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:15.127 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:15:15.127 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:15:15.129 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:15.134 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:15.134 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:15.134 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:15.134 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:15.136 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:15.139 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.144 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:15.154 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@76c1517f
12:15:15.156 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:15.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.157401 20642 hybrid_clock.cc:648] HybridClock initialized: now 1783512915157326 us; error 77 us; skew 500 ppm
12:15:15.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.158598 20642 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:15.162 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.168 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.169 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.170 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.170 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.170 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.171 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.171 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.172 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.172 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.172 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.173 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.173 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.173 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.173 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.174 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.174 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.174 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.174 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.174 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.175 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.175 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.179334 20642 webserver.cc:533] Webserver started at http://127.19.223.193:43345/ using document root <none> and password file <none>
12:15:15.180 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.180366 20642 fs_manager.cc:362] Metadata directory not provided
12:15:15.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.180655 20642 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:15.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.181200 20642 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:15.182 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.184 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.186678 20642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data/instance:
12:15:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:15.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:15 on dist-test-slave-vcgh"
12:15:15.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.187923 20642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal/instance:
12:15:15.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:15.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:15 on dist-test-slave-vcgh"
12:15:15.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.197 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.196471 20642 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
12:15:15.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.201 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.201 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.201 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.201 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.203397 20704 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:15.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.204610 20642 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
12:15:15.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.204981 20642 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal
12:15:15.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:15.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:15 on dist-test-slave-vcgh"
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.205452 20642 fs_report.cc:389] FS layout report
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data/data
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:15.209 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.209 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.209 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.210 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.212 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.217 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.221 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.221 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.221 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.222 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.224 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.225 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.225 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.225 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.225 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.229 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.232 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.235 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.239 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.240 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.244 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:15.245 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:15.245 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:15.245 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:15.245 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:15.245 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:15.246 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:15.246 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:15.246 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:15.246 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:15.246 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:15.246 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:15.246 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:15.250 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.250 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.250 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.253 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.253 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.258 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.263 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.268 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.269 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.271 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.271 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.272 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.275 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.275 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.275 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.275 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.278 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.279 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.280 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.280 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.280 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.283 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.283 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.284 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.285 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.286 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.286 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.287 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.287 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.288 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.288 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.288 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.289 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.289 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.289 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.289 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.290 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.290 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.290 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.290 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.290 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.290 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.290 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.291 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.291 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.291 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.291 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.291 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.292 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.293 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.293 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.294 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.294 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.295 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.295 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.295 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.295 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.296 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.296 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.296 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.296 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.297 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.299 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.299 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.299 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.299 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.299 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.299 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.299 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.299 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.299 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.299 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.300 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.300 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.300 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.300 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.300 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.300 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.300 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.300 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.301 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:15.301 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:15.302 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:15.302 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.302 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.302 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.302 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.302 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.303 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.303 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.303 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.303 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:15.306 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.306 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.306 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.306 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.308 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.308 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.308 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.308 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.308 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.308 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.309 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.309 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.312 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.312 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.312 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.314 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.314 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.314 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.314 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.314 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.315 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.315 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.315 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.315 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.315 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.315 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.316 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.316 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.316 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.316 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.317 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.317 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.317 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.317 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.317 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.317 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.318 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.318 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.318 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.318 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.320 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.320 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.320 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.320 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.320 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.320 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.321 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.321 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.321 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.321 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.321 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.322 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.322 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.323 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.323 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.323 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.323 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.323 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.323 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.323 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.325 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.331 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.331 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.331 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.332 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.332 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.332 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.332 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.332 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.333 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.333 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.333 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.334 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.334 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.334 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.334 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.334 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.334 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.334 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.336 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.336 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.336 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.336 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.336 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.337 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.337 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.337 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.337 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.337 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.339 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.340 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.340 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.340 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.340 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.340 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.340 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.340 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.340 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.340 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.340 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.340 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.340 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.342 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.342 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.342 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.342 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.342 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.343 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.343771 20642 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:15.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.345400 20642 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:15.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.345934 20642 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:15.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.355129 20642 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:15.355 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.356 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.356 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.356 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.356 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.356 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.357 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.357 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.357 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.360 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.360 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.360 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.360 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.362 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.363 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.363 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.363 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.363 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.363 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.363 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.363 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.363 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.364 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.364 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.364 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.364 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.372 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.372 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.372 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.372 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.372 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.372 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.373 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.373 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.373 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.373 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.373 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.373 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.373 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.374 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.374 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.374 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.375 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.376931 20642 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:15.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.377167 20642 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:15.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.377471 20642 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:15.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.377643 20642 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:15.385 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512915385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:15.393 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.394 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.394 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.394 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.395 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:15:15.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.395 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.395 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.395 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.397 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
12:15:15.400 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.400 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.400 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.403 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.405 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.406 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.406 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.407 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.407 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.408 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.408 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.408 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.408 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.408 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.415 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.416 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.416 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.416 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.416 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.416 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.417 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.417 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.417 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.417 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.417 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.417 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.452 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.452 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.453 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.454 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.454 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.455 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.455 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.456 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.456 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.456 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.456 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.475 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.475 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.476 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.476 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.477 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.477 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.477 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.477 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.477 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.477 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.477 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.540 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.541 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.541 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.541 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.542 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.542 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.542 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.542 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.543 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.543 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.543 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.543 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.543 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.543 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.544 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.544 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.544 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.544 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.544 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.544 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.544 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.544 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.545 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.552 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.552 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.553 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.553 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.554 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.554 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.557 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.557 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.561 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:15.561 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:15.561 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:15.562 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.562 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.562 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.562 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.562 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.562 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.563 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.563 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.563 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.563 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:15.636 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.636 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.636 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.637 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.637 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.637 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.638 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.638 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.638 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.638 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.638 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.638 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.652 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.652 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.652 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.654 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.680 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.680 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.680 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.681 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.681 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.681 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.681 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.681 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.681 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.682 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.682 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.682 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.682 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.694 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:15.694 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:15.694 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:15.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.694 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.694 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:15.695 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.695 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.696 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:15.696 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.696 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.696 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:15.696 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:15.697 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.698 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.698 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.698 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.698 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.698 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.698 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.698 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.743 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:15.743 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:15.743 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:15.744 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.744 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.744 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:15.745 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.745 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.745 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:15.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.745 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:15.745 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:15.812 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.812 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.812 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.814 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.886 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512915885 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:15.895 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:15:15.896 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
12:15:15.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.942999 20642 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.193:34773
12:15:15.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.943116 20847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.193:34773 every 8 connection(s)
12:15:15.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.946254 20642 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/data/info.pb
12:15:15.953 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:15.953 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:15.953 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:15.955 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.955 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.955 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:15.958 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.958 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.959 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:15.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.959 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:15.959 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:15.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.956297 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20642
12:15:15.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.956990 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-0/wal/instance
12:15:15.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:15.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:15.995456 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/logs
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data/info.pb
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.194:0
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.194
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.194
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:15.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:15.999 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.000 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.000 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.000 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.001 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.012765 20849 heartbeater.cc:344] Connected to a master server at 127.19.223.253:37033
12:15:16.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.013286 20849 heartbeater.cc:461] Registering TS with master...
12:15:16.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.014349 20848 heartbeater.cc:344] Connected to a master server at 127.19.223.252:41911
12:15:16.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.014599 20849 heartbeater.cc:507] Master 127.19.223.253:37033 requested a full tablet report, sending...
12:15:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.014807 20848 heartbeater.cc:461] Registering TS with master...
12:15:16.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.015837 20848 heartbeater.cc:507] Master 127.19.223.252:41911 requested a full tablet report, sending...
12:15:16.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.019608 20472 ts_manager.cc:194] Registered new tserver with Master: 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773)
12:15:16.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.022212 20554 ts_manager.cc:194] Registered new tserver with Master: 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773)
12:15:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.023394 20852 heartbeater.cc:344] Connected to a master server at 127.19.223.254:42193
12:15:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.023762 20852 heartbeater.cc:461] Registering TS with master...
12:15:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.024580 20852 heartbeater.cc:507] Master 127.19.223.254:42193 requested a full tablet report, sending...
12:15:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.025178 20554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.223.193:52743
12:15:16.026 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:16.026 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:16.026 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:16.026 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.026 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.027 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.027 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.027 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.027 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.026 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.027 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:16.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.027563 20396 ts_manager.cc:194] Registered new tserver with Master: 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773)
12:15:16.039 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.039 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.040 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.040 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.040 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.040 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.041 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.041 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.041 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.041 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.053 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.053 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.053 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.054 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.054 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.054 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.054 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.054 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.054 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.054 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.054 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.054 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.055 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.074 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.074 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.074 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.074 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.074 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.075 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.076 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.076 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.076 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.076 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.076 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.076 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.077 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.077 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.077 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.077 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.077 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.077 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.116 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:16.116 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:16.116 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:16.117 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:16.117 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:16.117 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:16.117 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:16.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:16.117 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:16.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:16.117 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:16.117 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:16.117 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:16.142 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.143 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.143 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.143 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.143 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.144 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.144 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.144 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.145 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:16.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:16.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:16.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:16.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.275 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.275 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.275 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.275 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:16.301 [DEBUG - pool-174-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.16.194.124:36205, [5ms] received response from server master-127.16.194.124:36205: OK, deferred=null) with no deferred attached!
12:15:16.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:16.386 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512916385 for job 5184ffe83187ccec3ebfd9d613debdde.
12:15:16.393 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 5184ffe83187ccec3ebfd9d613debdde (2314 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:16.394 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
12:15:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.414337 20858 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.414868 20858 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.415458 20858 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:16.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.451785 20858 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:16.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.452663 20858 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.223.194
12:15:16.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.490218 20858 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.194:0
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data/info.pb
12:15:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.194
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.194
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/logs
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:16.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.491508 20858 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:16.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:16.493192 20858 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:16.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.506642 20865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:16.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:16.712 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:16.713 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:16.713 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:16.713 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.713 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.713 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:16.714 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.714 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.714 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:16.714 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.714 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.714 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:16.714 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:16.744 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:16.745 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:16.745 [DEBUG - pool-234-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:16.745 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:16.745 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:16.745 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:16.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:16.746 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:16.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:16.745 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:16.746 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:16.746 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:16.746 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:16.747 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
12:15:16.748 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=18e98bc7615e4665a6e500c1cab31dda, attempt=4, KuduRpc(method=Scan, tablet=18e98bc7615e4665a6e500c1cab31dda, attempt=4, TimeoutTracker(timeout=30000, elapsed=28419), Traces: [0ms] sending RPC to server e97303c2e1ff42e8b6b9cb1d543e3f88, [397ms] received response from server e97303c2e1ff42e8b6b9cb1d543e3f88: Network error: connection closed, [397ms] delaying RPC due to: Network error: connection closed, [400ms] sending RPC to server b65f7d707d2a4b17b865e73c787428ee, [406ms] received response from server b65f7d707d2a4b17b865e73c787428ee: Network error: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145, [406ms] delaying RPC due to: Network error: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145, [420ms] sending RPC to server 5f32f8c83f4c4a3e9837d363869a92cb, [439ms] received response from server 5f32f8c83f4c4a3e9837d363869a92cb: Network error: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941, [439ms] delaying RPC due to: Network error: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941, [460ms] refreshing cache from master, [460ms] Sub RPC GetTableLocations: refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [474ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [477ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [488ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [519ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [519ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [540ms] Sub RPC GetTableLocations: refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [542ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [543ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [543ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [543ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [560ms] Sub RPC GetTableLocations: refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [580ms] Sub RPC GetTableLocations: refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [581ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [581ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [600ms] Sub RPC GetTableLocations: refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [601ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [601ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [602ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [602ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [620ms] Sub RPC GetTableLocations: refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [621ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [621ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [622ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [622ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [640ms] Sub RPC GetTableLocations: refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [641ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [641ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [641ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [641ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [760ms] Sub RPC GetTableLocations: refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [762ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [762ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [763ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [763ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] Sub RPC GetTableLocations: refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [901ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1020ms] Sub RPC GetTableLocations: refreshing cache from master, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1021ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1021ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1360ms] Sub RPC GetTableLocations: refreshing cache from master, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1362ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1780ms] Sub RPC GetTableLocations: refreshing cache from master, [1781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1781ms] too many traces: truncated at 100 traces, deferred=Deferred@1715618215(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.126:33897
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:16.758 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.126:33897
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:16.760 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
12:15:16.760 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.126:33897
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:16.760 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] disconnecting while in state TERMINATED
12:15:16.760 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] disconnecting while in state TERMINATED
12:15:16.761 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.16.194.126:33897(127.16.194.126:33897)] disconnecting while in state TERMINATED
12:15:16.761 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.16.194.124:36205(127.16.194.124:36205)] disconnecting while in state TERMINATED
12:15:16.761 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state TERMINATED
12:15:16.761 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.16.194.125:40961(127.16.194.125:40961)] disconnecting while in state TERMINATED
12:15:16.761 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:16.762 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
12:15:16.762 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:15:16.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.17.135.254:37603(127.17.135.254:37603)] disconnecting while in state TERMINATED
12:15:16.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.17.135.252:38447(127.17.135.252:38447)] disconnecting while in state TERMINATED
12:15:16.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 414328f38a134d6eaa3ce2c7212c587e(127.17.135.194:38601)] disconnecting while in state TERMINATED
12:15:16.763 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.17.135.253:43339(127.17.135.253:43339)] disconnecting while in state TERMINATED
12:15:16.762 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:15:16.763 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:16.764 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:15:16.764 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:16.764 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
12:15:16.769 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
12:15:16.773 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:16.773 [WARN - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.126:33897
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:16.774 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:15:16.781 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:15:16.785 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=23, TimeoutTracker(timeout=29504, elapsed=27922), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [17ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [28ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [59ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xae35a26e, L:/127.0.0.1:52342 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [83ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [142ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [142ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [302ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [303ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [303ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [901ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1321ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1322ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [3740ms] refreshing cache from master, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [3740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [3741ms] too many traces: truncated at 100 traces, deferred=Deferred@840827593(state=PENDING, result=null, callback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062), errback=(continuation of Deferred@79893006 after retry RPC after error@1952129317) -> (continuation of Deferred@283556096 after retry RPC after error@1387063711) -> (continuation of Deferred@1315160742 after retry RPC after error@1662816326) -> (continuation of Deferred@1184304028 after retry RPC after error@1942151872) -> (continuation of Deferred@602171628 after retry RPC after error@620581494) -> (continuation of Deferred@1514694302 after retry RPC after error@1056459765) -> (continuation of Deferred@1046214606 after retry RPC after error@1887136913) -> (continuation of Deferred@1772001430 after retry RPC after error@356897203) -> (continuation of Deferred@1958850898 after retry RPC after error@1609909439) -> (continuation of Deferred@1110588927 after retry RPC after error@2042733635) -> (continuation of Deferred@15978760 after retry RPC after error@1977003285) -> (continuation of Deferred@643349397 after retry RPC after error@1380966561) -> (continuation of Deferred@1277825137 after retry RPC after error@206877412) -> (continuation of Deferred@1865622760 after retry RPC after error@1121229639) -> (continuation of Deferred@1591845620 after retry RPC after error@2005657694) -> (continuation of Deferred@32085539 after retry RPC after error@1728134138) -> (continuation of Deferred@874828780 after retry RPC after error@482673710) -> (continuation of Deferred@1372639515 after retry RPC after error@1071705648) -> (continuation of Deferred@759820691 after retry RPC after error@429487200) -> (continuation of Deferred@1310078529 after retry RPC after error@1983889629) -> (continuation of Deferred@337146592 after retry RPC after error@1181761143) -> (continuation of Deferred@959163590 after retry RPC after error@823831062)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.126:33897
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:16.786 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:16.786 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:15:16.786 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:16.786 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:15:16.786 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:16.786 [WARN - flink-pekko.actor.default-dispatcher-6] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:15:16.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.787 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.787 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:16.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:16.788 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:15:16.795 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:16.795 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:16.796 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:16.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.796 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.796 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:16.796 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.796 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.796 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:16.797 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.797 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.797 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:16.797 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:16.805 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:16.805 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:16.806 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:16.806 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.806 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.806 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.806 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.806 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.806 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.806 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.806 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.807 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:16.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:16.858 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:16.858 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:16.858 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:16.859 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.859 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.859 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:16.859 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.859 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.860 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:16.860 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.860 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.860 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:16.860 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:16.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:17.030997 20848 heartbeater.cc:499] Master 127.19.223.252:41911 was elected leader, sending a full tablet report...
12:15:17.058 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:17.058 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:17.059 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:17.059 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.059 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.060 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.060 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.060 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.060 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.060 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.060 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.060 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:17.082 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:17.083 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:17.083 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:17.083 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.083 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.083 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.084 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.084 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.084 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.084 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.084 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:17.169 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:17.169 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:17.169 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:17.170 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.171 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.171 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.171 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.171 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:17.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.283 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:17.283 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:17.283 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:17.284 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.284 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.284 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.284 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.284 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.285 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.285 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.285 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.285 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:17.344 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:17.345 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:17.345 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:17.345 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.345 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.345 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.346 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.346 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.346 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.346 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:17.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.392 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:17.392 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:17.392 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:17.393 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:17.393 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:17.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:17.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:17.393 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:17.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:17.393 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:17.393 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:17.393 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:17.393 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:17.410 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:17.410 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:17.410 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:17.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.411 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.412 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:17.459 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:17.459 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:17.460 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:17.460 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.460 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.460 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.461 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:17.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.659 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.126:33897(127.16.194.126:33897)] connecting to peer
12:15:17.659 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.124:36205(127.16.194.124:36205)] connecting to peer
12:15:17.660 [DEBUG - pool-236-thread-1] (Connection.java:748) [peer master-127.16.194.125:40961(127.16.194.125:40961)] connecting to peer
12:15:17.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.660 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.194.126:33897(127.16.194.126:33897)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.660 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.194.124:36205(127.16.194.124:36205)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.124:36205: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205
12:15:17.660 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.126:33897: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897
12:15:17.660 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.660 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.194.125:40961(127.16.194.125:40961)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.660 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.16.194.125:40961: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
12:15:17.660 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961; will retry
12:15:17.661 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
12:15:17.662 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=386b64c8ec0c469ebd53d12eadb01231, attempt=4, KuduRpc(method=Scan, tablet=386b64c8ec0c469ebd53d12eadb01231, attempt=4, TimeoutTracker(timeout=30000, elapsed=29347), Traces: [0ms] sending RPC to server e97303c2e1ff42e8b6b9cb1d543e3f88, [403ms] received response from server e97303c2e1ff42e8b6b9cb1d543e3f88: Network error: connection closed, [403ms] delaying RPC due to: Network error: connection closed, [421ms] sending RPC to server b65f7d707d2a4b17b865e73c787428ee, [423ms] received response from server b65f7d707d2a4b17b865e73c787428ee: Network error: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145, [423ms] delaying RPC due to: Network error: Failed to connect to peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145): Connection refused: /127.16.194.65:46145, [440ms] sending RPC to server 5f32f8c83f4c4a3e9837d363869a92cb, [449ms] received response from server 5f32f8c83f4c4a3e9837d363869a92cb: Network error: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941, [449ms] delaying RPC due to: Network error: Failed to connect to peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941): Connection refused: /127.16.194.66:35941, [461ms] refreshing cache from master, [461ms] Sub RPC GetTableLocations: refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [463ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [465ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [466ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [486ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [525ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [525ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [541ms] Sub RPC GetTableLocations: refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [543ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [546ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [547ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [547ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [547ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [561ms] Sub RPC GetTableLocations: refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [562ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [562ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [562ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [581ms] Sub RPC GetTableLocations: refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [581ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [582ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [582ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [582ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [600ms] Sub RPC GetTableLocations: refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [601ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [602ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [602ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [602ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [621ms] Sub RPC GetTableLocations: refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [622ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [622ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [623ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [623ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [641ms] Sub RPC GetTableLocations: refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [642ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [642ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [642ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [642ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [661ms] Sub RPC GetTableLocations: refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [662ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [662ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [663ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [663ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [801ms] Sub RPC GetTableLocations: refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [802ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [802ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [802ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [803ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [803ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [900ms] Sub RPC GetTableLocations: refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [902ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [902ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1521ms] Sub RPC GetTableLocations: refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1522ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1522ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2021ms] Sub RPC GetTableLocations: refreshing cache from master, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2021ms] too many traces: truncated at 100 traces, deferred=Deferred@1596234140(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.125:40961
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:17.662 [DEBUG - kudu-nio-2] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.125:40961
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
12:15:17.663 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.125:40961
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer b65f7d707d2a4b17b865e73c787428ee(127.16.194.65:46145)] disconnecting while in state TERMINATED
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 5f32f8c83f4c4a3e9837d363869a92cb(127.16.194.66:35941)] disconnecting while in state TERMINATED
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.16.194.126:33897(127.16.194.126:33897)] disconnecting while in state TERMINATED
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.16.194.124:36205(127.16.194.124:36205)] disconnecting while in state TERMINATED
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer e97303c2e1ff42e8b6b9cb1d543e3f88(127.16.194.67:34965)] disconnecting while in state TERMINATED
12:15:17.663 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.16.194.125:40961(127.16.194.125:40961)] disconnecting while in state TERMINATED
12:15:17.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.17.135.254:37603(127.17.135.254:37603)] disconnecting while in state TERMINATED
12:15:17.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.17.135.252:38447(127.17.135.252:38447)] disconnecting while in state TERMINATED
12:15:17.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.17.135.253:43339(127.17.135.253:43339)] disconnecting while in state TERMINATED
12:15:17.666 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:17.666 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:17.666 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-2
12:15:17.667 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
12:15:17.667 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:15:17.667 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-5
12:15:17.667 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:15:17.669 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:15:17.671 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:17.671 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:15:17.672 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:15:17.672 [WARN - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.125:40961
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:17.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:15:17.677 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:15:17.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.701 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 3 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=24, TimeoutTracker(timeout=29495, elapsed=28841), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [4ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [25ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961], [64ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [64ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: [peer master-127.16.194.125:40961(127.16.194.125:40961)] unexpected exception from downstream on [id: 0x59d9e5e7, L:/127.0.0.1:57962 - R:/127.16.194.125:40961],org.apache.kudu.client.RecoverableException: [peer master-127.16.194.124:36205(127.16.194.124:36205)] unexpected exception from downstream on [id: 0xc6985d28, L:/127.0.0.1:52330 - R:/127.16.194.124:36205], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [82ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [86ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [86ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [100ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [101ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [101ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [120ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [121ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [121ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [139ms] refreshing cache from master, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [140ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [141ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [141ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [161ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [162ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [162ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [181ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [181ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [201ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [202ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [202ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [341ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [342ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [342ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [439ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [441ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [441ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1060ms] refreshing cache from master, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1061ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1061ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1560ms] refreshing cache from master, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [1560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.126:33897: Network error: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.124:36205: Network error: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.16.194.125:40961: Network error: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [1561ms] delaying RPC due to: Service unavailable: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961, [2920ms] refreshing cache from master, [2920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.126:33897, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.124:36205, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.194.125:40961, [2921ms] too many traces: truncated at 100 traces, deferred=Deferred@308799990(state=PENDING, result=null, callback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149), errback=(continuation of Deferred@1764289499 after retry RPC after error@275991476) -> (continuation of Deferred@54852759 after retry RPC after error@776052048) -> (continuation of Deferred@1690992 after retry RPC after error@171776044) -> (continuation of Deferred@775548344 after retry RPC after error@204496434) -> (continuation of Deferred@1108111497 after retry RPC after error@546499740) -> (continuation of Deferred@1093107995 after retry RPC after error@1340638915) -> (continuation of Deferred@1858158479 after retry RPC after error@1493227719) -> (continuation of Deferred@609400229 after retry RPC after error@797434226) -> (continuation of Deferred@1214090826 after retry RPC after error@390373734) -> (continuation of Deferred@646631862 after retry RPC after error@915814500) -> (continuation of Deferred@303943458 after retry RPC after error@551551894) -> (continuation of Deferred@1343709533 after retry RPC after error@1472542243) -> (continuation of Deferred@735938342 after retry RPC after error@184667512) -> (continuation of Deferred@1618434252 after retry RPC after error@511512271) -> (continuation of Deferred@1499356817 after retry RPC after error@1546724047) -> (continuation of Deferred@106606781 after retry RPC after error@1890045391) -> (continuation of Deferred@1529261980 after retry RPC after error@240437613) -> (continuation of Deferred@1566072642 after retry RPC after error@325003411) -> (continuation of Deferred@2112565035 after retry RPC after error@1440521818) -> (continuation of Deferred@1256290796 after retry RPC after error@546360211) -> (continuation of Deferred@69614301 after retry RPC after error@901335629) -> (continuation of Deferred@1951824655 after retry RPC after error@1388116549) -> (continuation of Deferred@1744421405 after retry RPC after error@418187149)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.16.194.126:33897,127.16.194.124:36205,127.16.194.125:40961) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.124:36205(127.16.194.124:36205): Connection refused: /127.16.194.124:36205,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.126:33897(127.16.194.126:33897): Connection refused: /127.16.194.126:33897,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.16.194.125:40961(127.16.194.125:40961): Connection refused: /127.16.194.125:40961
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.16.194.125:40961
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:17.702 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:15:17.702 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:15:17.703 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:17.730 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:17.730 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:17.730 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:17.731 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.731 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:17.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.731 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:17.731 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.732 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:17.732 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:17.765 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:17.765 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:17.765 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:17.766 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.766 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.766 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:17.767 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.767 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.767 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:17.767 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.767 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.767 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:17.767 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:17.793 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:17.794 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:17.794 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:17.794 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:17.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:17.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:17.795 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:17.822 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:17.823 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:17.823 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:17.823 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:17.824 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:17.824 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:17.824 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:17.824 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:17.824 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:17.825 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:17.825 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:17.825 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:17.825 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:17.833 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:15:17.834 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
12:15:17.834 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:15:17.834 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
12:15:17.835 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
12:15:17.835 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 662c4bfa88ebb225fdaa868646c1528c
12:15:17.835 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:15:17.836 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 662c4bfa88ebb225fdaa868646c1528c.
12:15:17.837 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id 662c4bfa88ebb225fdaa868646c1528c.
12:15:17.837 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:17.837 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
12:15:17.838 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
12:15:17.838 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@775c8b11
12:15:17.838 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:17.838 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:15:17.839 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:15:17.839 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:15:17.840 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
12:15:17.840 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:15:17.840 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:15:17.841 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:17.842 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:15:17.842 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 71b57ea17b002970ac3f421ada230e68
12:15:17.842 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:15:17.842 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:15:17.842 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@706c38e5
12:15:17.843 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 71b57ea17b002970ac3f421ada230e68.
12:15:17.844 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:17.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.854 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:15:17.854 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:15:17.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7afb5fcd
12:15:17.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:17.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:15:17.855 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:15:17.855 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:15:17.861 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.861 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.863 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.863 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.864 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.864 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.865 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3cb92a63
12:15:17.867 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:17.882 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.882 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.882 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.882 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.887 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.893 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.893 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.893 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.901 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.901 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.902 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.902 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.902 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.908 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.908 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.908 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.908 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.911 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.914 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.914 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.915 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.915 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.915 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.916 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.916 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.921 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.924 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.928 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.928 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.928 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.929 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.935 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.937 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.940 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.941 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.941 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.941 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.941 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.941 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.941 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.941 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.941 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.942 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.942 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.942 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.942 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.942 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.949 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.949 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.949 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.949 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.961 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.961 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.961 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.962 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.962 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.962 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.962 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.962 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.962 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.963 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.963 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.963 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.963 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:17.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:17.968 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:17.977 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:17.978 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.978 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:17.984 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:17.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:17.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:17.985 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.001 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.001 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.001 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.003 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.003 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.003 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.007 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.008 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.008 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.009 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.022 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.023 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.027 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.027 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.028 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.028 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.028 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.029 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.068 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.068 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.069 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.069 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.069 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.069 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.070 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.070 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.070 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.088 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.088 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.088 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.089 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.089 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.089 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.090 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.090 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.090 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.090 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.090 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.100 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:18.100 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:18.100 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:18.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.102 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.102 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:18.121 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.121 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.121 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.122 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.122 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.122 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.123 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:18.123 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:18.123 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.123 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.123 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:18.123 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.123 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.123 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.123 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.123 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.124 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.124 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.124 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.124 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.124 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.124 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.124 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:18.123 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.125 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.128 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.128 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.128 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.128 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.129 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.129 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.129 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.129 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.129 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.129 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.129 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.181 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.181 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.181 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.183 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.183 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.183 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:18.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:18.293 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:18.294 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.294 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.294 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.294 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.294 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.294 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.294 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.295 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:18.300 [DEBUG - pool-174-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30014), Traces: [0ms] sending RPC to server master-127.16.194.124:36205, [14ms] received response from server master-127.16.194.124:36205: OK, deferred=null) with no deferred attached!
12:15:18.327 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.328 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.328 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.329 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.329 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.329 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.329 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.394 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:18.394 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:18.394 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:18.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:18.395 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:18.395 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:18.395 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:18.395 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:18.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:18.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:18.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:18.395 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:18.395 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:18.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:18.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:18.533 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:18.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:18.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:18.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:18.535 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:18.535 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:18.535 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:18.535 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:18.535 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:18.535 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:18.535 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:18.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.539611 19668 debug-util.cc:398] Leaking SignalData structure 0x7b080009edc0 after lost signal to thread 19563
12:15:18.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.540458 19668 debug-util.cc:398] Leaking SignalData structure 0x7b08000a39c0 after lost signal to thread 19671
12:15:18.580 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:18.580 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:18.580 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:18.581 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.581 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.581 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.581 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.581 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.581 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.581 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.581 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.582 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.582 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:18.626 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:18.626 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:18.627 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:18.627 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.627 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.627 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:18.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:18.627 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.627 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.627 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:18.627 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:18.628 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.628 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.628 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.628 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.628 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.628 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.628 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.629 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.629 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.629 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.629 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.629 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.629 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.653 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:18.654 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:18.654 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:18.654 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.654 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.654 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.654 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.654 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.686 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.686 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.687 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.687 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.687 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.688 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.688 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.688 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.688 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.688 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.688 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.689 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.689 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:17.908063 20864 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 20858
12:15:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.682062 20864 kernel_stack_watchdog.cc:198] Thread 20858 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 395ms:
12:15:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.682829 20858 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.172s	user 0.797s	sys 1.335s
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.683193 20858 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.173s	user 0.797s	sys 1.335s
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:16.510166 20866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.685036 20868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:18.693 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.693 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:18.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:18.704272 20867 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2173 milliseconds
12:15:18.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.704347 20858 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:18.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.705770 20858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:18.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.709232 20858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.710646 20858 hybrid_clock.cc:648] HybridClock initialized: now 1783512918710578 us; error 72 us; skew 500 ppm
12:15:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.711722 20858 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:18.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.720090 20858 webserver.cc:533] Webserver started at http://127.19.223.194:44821/ using document root <none> and password file <none>
12:15:18.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.721302 20858 fs_manager.cc:362] Metadata directory not provided
12:15:18.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.721557 20858 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:18.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.722131 20858 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.728863 20858 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data/instance:
12:15:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ac51161fda3d472ab4a07ec520f694dc"
12:15:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:18 on dist-test-slave-vcgh"
12:15:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.730547 20858 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal/instance:
12:15:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ac51161fda3d472ab4a07ec520f694dc"
12:15:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:18 on dist-test-slave-vcgh"
12:15:18.736 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:18.736 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:18.736 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:18.736 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.736 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.736 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.737 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:18.737 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:18.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.737 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.737 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:18.737 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:18.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.742142 20858 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.007s	sys 0.001s
12:15:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.749661 20904 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:18.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.750891 20858 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
12:15:18.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.751339 20858 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal
12:15:18.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ac51161fda3d472ab4a07ec520f694dc"
12:15:18.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:18 on dist-test-slave-vcgh"
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.751748 20858 fs_report.cc:389] FS layout report
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data/data
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:18.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:18.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.825826 20858 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:18.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.827729 20858 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:18.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.828254 20858 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:18.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.831629 20858 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:18.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.837169 20858 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:18.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.837435 20858 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:18.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.837713 20858 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:18.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:18.837926 20858 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:18.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:18.948 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:18.948 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:18.949 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.949 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.949 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:18.949 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:18.950 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.950 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.950 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:18.950 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.950 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.950 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:18.950 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:18.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.022 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:19.023 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:19.023 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:19.023 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.023 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.024 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.024 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.024 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.024 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.024 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.025 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.025 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.040534 20858 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.194:44817
12:15:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.041283 21016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.194:44817 every 8 connection(s)
12:15:19.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.043812 20858 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/data/info.pb
12:15:19.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.048411 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 20858
12:15:19.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.048902 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-1/wal/instance
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.072654 20351 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/logs
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data/info.pb
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.195:0
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.195
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.195
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:19.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.112782 21017 heartbeater.cc:344] Connected to a master server at 127.19.223.252:41911
12:15:19.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.113309 21017 heartbeater.cc:461] Registering TS with master...
12:15:19.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.114694 21017 heartbeater.cc:507] Master 127.19.223.252:41911 requested a full tablet report, sending...
12:15:19.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.117559 20554 ts_manager.cc:194] Registered new tserver with Master: ac51161fda3d472ab4a07ec520f694dc (127.19.223.194:44817)
12:15:19.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.119268 20554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.223.194:50529
12:15:19.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.122303 21018 heartbeater.cc:344] Connected to a master server at 127.19.223.253:37033
12:15:19.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.122648 21018 heartbeater.cc:461] Registering TS with master...
12:15:19.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.123256 21018 heartbeater.cc:507] Master 127.19.223.253:37033 requested a full tablet report, sending...
12:15:19.125 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:19.125 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:19.126 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:19.126 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.126 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.126 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.126 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.127 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.127 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.127 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.127 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.127 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.124521 21021 heartbeater.cc:344] Connected to a master server at 127.19.223.254:42193
12:15:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.124866 21021 heartbeater.cc:461] Registering TS with master...
12:15:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.125443 21021 heartbeater.cc:507] Master 127.19.223.254:42193 requested a full tablet report, sending...
12:15:19.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.126317 20472 ts_manager.cc:194] Registered new tserver with Master: ac51161fda3d472ab4a07ec520f694dc (127.19.223.194:44817)
12:15:19.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.130407 20396 ts_manager.cc:194] Registered new tserver with Master: ac51161fda3d472ab4a07ec520f694dc (127.19.223.194:44817)
12:15:19.167 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:19.168 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:19.168 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:19.168 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.168 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.168 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.168 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.168 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.169 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.169 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:19.190 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.221 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:19.221 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:19.221 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:19.221 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.221 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.221 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.222 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:19.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.346 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:19.346 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:19.346 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:19.347 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.347 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.347 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.347 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.347 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.347 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.347 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.347 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.347 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.347 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:19.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.355 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:19.356 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:19.356 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:19.356 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.356 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.356 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.357 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.357 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.357 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.357 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.357 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.357 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:19.361 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:19.362 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:19.362 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:19.362 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.362 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.362 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.362 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.362 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.362 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.362 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.362 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.362 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:19.403 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:19.403 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:19.403 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:19.403 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:19.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:19.404 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:19.404 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:19.404 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:19.404 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:19.404 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:19.404 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:19.404 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:19.404 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:19.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:19.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:19.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:19.513 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:19.513 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:19.513 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:19.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:19.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:19.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:19.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:19.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:19.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:19.515 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.553182 21027 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.553821 21027 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.554541 21027 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:19.588 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:19.588 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:19.589 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:19.589 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.589 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.589 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:19.589 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.589 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.589 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:19.589 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.589 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.590 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:19.590 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:19.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.595522 21027 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:19.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.596344 21027 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.223.195
12:15:19.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.636456 21027 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:19.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.19.223.212:38467
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.19.223.195:0
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data/info.pb
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.19.223.195
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.19.223.254:42193,127.19.223.253:37033,127.19.223.252:41911
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.19.223.195
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/logs
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:19.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.637745 21027 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:19.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:19.639416 21027 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.652757 21033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:19.698 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.778 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:19.778 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:19.778 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:19.779 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.779 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.779 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:19.779 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.779 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.779 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:19.780 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.780 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.780 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:19.780 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:19.793 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:19.793 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:19.793 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:19.793 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.793 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.793 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:19.794 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.794 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.794 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.794 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.794 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:19.794 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:19.794 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:19.819 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:19.820 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:19.820 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:19.820 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.820 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.820 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:19.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:19.821 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.821 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.821 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:19.821 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:19.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:19.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:20.123910 21017 heartbeater.cc:499] Master 127.19.223.252:41911 was elected leader, sending a full tablet report...
12:15:20.124 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:20.124 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:20.125 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:20.125 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:20.125 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:20.125 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:20.125 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:20.125 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:20.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:20.126 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:20.126 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:20.126 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:20.126 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:20.141 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:20.141 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:20.142 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:20.142 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:20.142 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:20.142 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:20.142 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:20.142 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:20.143 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:20.143 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:20.143 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:20.143 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:20.143 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:20.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:20.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:20.333 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:20.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:20.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:20.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:20.334 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:20.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:20.334 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:20.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:20.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:20.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:20.335 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:20.336 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:20.336 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:20.336 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:20.337 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.337 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.337 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.338 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.338 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.338 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.338 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:20.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.413 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:20.413 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:20.414 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:20.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.414 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.415 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:20.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:20.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:20.533 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:20.533 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:20.533 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:20.533 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:20.533 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:20.533 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:20.533 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:20.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:20.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:20.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:20.534 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:20.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.929 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:20.929 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:20.929 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:20.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.930 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.930 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.930 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.930 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.930 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.931 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.931 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.931 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.931 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:20.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:20.970 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:20.971 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:20.971 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:20.971 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.971 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:20.972 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.972 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.972 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:20.972 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.972 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.972 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:20.972 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:21.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:21.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:21.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:21.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:21.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:21.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:21.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:21.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:21.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:21.025 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:21.025 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:21.025 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:21.025 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:21.086 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:21.086 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:21.086 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:21.087 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.087 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.087 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.087 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.087 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.088 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.088 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:21.091 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:21.092 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:21.092 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:21.092 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.092 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.092 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.092 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.092 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.092 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.093 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.093 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.093 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.093 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:21.093 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:21.093 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:21.093 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:21.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:21.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:21.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:21.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:21.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:21.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:21.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:21.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:21.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:21.095 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:21.121 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:21.121 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:21.122 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:21.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.123 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.123 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.123 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.123 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.123 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.123 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.123 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:21.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.282 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:21.283 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:21.283 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:21.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.284 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.284 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:21.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.364 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:21.365 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:21.365 [DEBUG - pool-244-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:21.365 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.365 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.365 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.366 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.366 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.366 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.366 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.366 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.366 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.366 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:21.367 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=26768), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [9ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [10ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [10ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [28ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [43ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [44ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [84ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [84ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [281ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1281ms] refreshing cache from master, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1283ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1284ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1284ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2560ms] refreshing cache from master, [2560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2562ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5460ms] refreshing cache from master, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5462ms] too many traces: truncated at 100 traces, deferred=Deferred@1128725890(state=PENDING, result=null, callback=(continuation of Deferred@1694132808 after retry RPC after error@545368597) -> (continuation of Deferred@1575244474 after retry RPC after error@700063337) -> (continuation of Deferred@505776444 after retry RPC after error@861489647) -> (continuation of Deferred@1280818364 after retry RPC after error@895986185) -> (continuation of Deferred@129608176 after retry RPC after error@2119605977) -> (continuation of Deferred@253067251 after retry RPC after error@120241146) -> (continuation of Deferred@1301705926 after retry RPC after error@133995515) -> (continuation of Deferred@590517776 after retry RPC after error@1897204967) -> (continuation of Deferred@257648199 after retry RPC after error@1822103316) -> (continuation of Deferred@1538166401 after retry RPC after error@42324775) -> (continuation of Deferred@1454961774 after retry RPC after error@1647278618) -> (continuation of Deferred@1297754712 after retry RPC after error@1642775615) -> (continuation of Deferred@1893750760 after retry RPC after error@1762004036) -> (continuation of Deferred@1964172246 after retry RPC after error@1122900599) -> (continuation of Deferred@818109141 after retry RPC after error@1778259109) -> (continuation of Deferred@185615903 after retry RPC after error@958384296) -> (continuation of Deferred@320878764 after retry RPC after error@182603089) -> (continuation of Deferred@63689388 after retry RPC after error@1154875637) -> (continuation of Deferred@1453438363 after retry RPC after error@1311892187) -> (continuation of Deferred@322049795 after retry RPC after error@1729592376) -> (continuation of Deferred@1019285548 after retry RPC after error@2108103253), errback=(continuation of Deferred@1694132808 after retry RPC after error@545368597) -> (continuation of Deferred@1575244474 after retry RPC after error@700063337) -> (continuation of Deferred@505776444 after retry RPC after error@861489647) -> (continuation of Deferred@1280818364 after retry RPC after error@895986185) -> (continuation of Deferred@129608176 after retry RPC after error@2119605977) -> (continuation of Deferred@253067251 after retry RPC after error@120241146) -> (continuation of Deferred@1301705926 after retry RPC after error@133995515) -> (continuation of Deferred@590517776 after retry RPC after error@1897204967) -> (continuation of Deferred@257648199 after retry RPC after error@1822103316) -> (continuation of Deferred@1538166401 after retry RPC after error@42324775) -> (continuation of Deferred@1454961774 after retry RPC after error@1647278618) -> (continuation of Deferred@1297754712 after retry RPC after error@1642775615) -> (continuation of Deferred@1893750760 after retry RPC after error@1762004036) -> (continuation of Deferred@1964172246 after retry RPC after error@1122900599) -> (continuation of Deferred@818109141 after retry RPC after error@1778259109) -> (continuation of Deferred@185615903 after retry RPC after error@958384296) -> (continuation of Deferred@320878764 after retry RPC after error@182603089) -> (continuation of Deferred@63689388 after retry RPC after error@1154875637) -> (continuation of Deferred@1453438363 after retry RPC after error@1311892187) -> (continuation of Deferred@322049795 after retry RPC after error@1729592376) -> (continuation of Deferred@1019285548 after retry RPC after error@2108103253)))
12:15:21.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:21.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:21.376 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:21.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.376 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:21.376 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.376 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:21.377 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.377 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.377 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:21.377 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:21.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.053972 21032 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 21027
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.402031 21032 kernel_stack_watchdog.cc:198] Thread 21027 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.402292 21027 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.748s	user 0.483s	sys 1.040s
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.402688 21027 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.749s	user 0.483s	sys 1.040s
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:19.654503 21034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.404523 21036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:21.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.408365 21035 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1753 milliseconds
12:15:21.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.408377 21027 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:21.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.409633 21027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:21.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.411660 21027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:21.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.413031 21027 hybrid_clock.cc:648] HybridClock initialized: now 1783512921412987 us; error 42 us; skew 500 ppm
12:15:21.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.413892 21027 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:21.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.420071 21027 webserver.cc:533] Webserver started at http://127.19.223.195:37575/ using document root <none> and password file <none>
12:15:21.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.421027 21027 fs_manager.cc:362] Metadata directory not provided
12:15:21.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.421253 21027 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:21.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.421696 21027 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:21.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.426131 21027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data/instance:
12:15:21.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a70185538824df48992807d60b77e4b"
12:15:21.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:21 on dist-test-slave-vcgh"
12:15:21.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.427304 21027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal/instance:
12:15:21.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a70185538824df48992807d60b77e4b"
12:15:21.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:21 on dist-test-slave-vcgh"
12:15:21.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.434360 21027 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:15:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.440828 21046 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:21.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.442296 21027 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.442673 21027 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6a70185538824df48992807d60b77e4b"
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:21 on dist-test-slave-vcgh"
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.443068 21027 fs_report.cc:389] FS layout report
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data/data
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:21.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:21.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.488824 21027 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:21.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.490324 21027 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:21.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.490711 21027 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:21.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.493335 21027 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.497597 21027 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.497804 21027 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:21.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.498036 21027 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:21.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.498167 21027 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:21.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.662309 21027 rpc_server.cc:307] RPC server started. Bound to: 127.19.223.195:41151
12:15:21.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.662406 21158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.223.195:41151 every 8 connection(s)
12:15:21.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.665078 21027 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/data/info.pb
12:15:21.670 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:21.670 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:21.670 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:21.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:21.675 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:21.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:21.675 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:21.675 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:21.675 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:21.676 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:21.676 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:21.676 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:21.676 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.671640 20351 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 21027
12:15:21.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.672130 20351 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster3390329296969862605/ts-2/wal/instance
12:15:21.693 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.727687 21161 heartbeater.cc:344] Connected to a master server at 127.19.223.254:42193
12:15:21.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.728157 21161 heartbeater.cc:461] Registering TS with master...
12:15:21.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.730130 21161 heartbeater.cc:507] Master 127.19.223.254:42193 requested a full tablet report, sending...
12:15:21.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.733075 20396 ts_manager.cc:194] Registered new tserver with Master: 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:21.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.742542 21159 heartbeater.cc:344] Connected to a master server at 127.19.223.252:41911
12:15:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.742913 21159 heartbeater.cc:461] Registering TS with master...
12:15:21.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.743839 21159 heartbeater.cc:507] Master 127.19.223.252:41911 requested a full tablet report, sending...
12:15:21.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.744999 21160 heartbeater.cc:344] Connected to a master server at 127.19.223.253:37033
12:15:21.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.745323 21160 heartbeater.cc:461] Registering TS with master...
12:15:21.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.746065 21160 heartbeater.cc:507] Master 127.19.223.253:37033 requested a full tablet report, sending...
12:15:21.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.746016 20554 ts_manager.cc:194] Registered new tserver with Master: 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:21.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.747601 20554 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.223.195:59731
12:15:21.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.748365 20472 ts_manager.cc:194] Registered new tserver with Master: 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:21.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.762276 20351 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:15:21.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.773 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:21.773 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:15:21.774 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.223.254"
      port: 42193
    }
    bound_http_address {
      host: "127.19.223.254"
      port: 45269
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.223.253"
      port: 37033
    }
    bound_http_address {
      host: "127.19.223.253"
      port: 45441
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.223.252"
      port: 41911
    }
    bound_http_address {
      host: "127.19.223.252"
      port: 41407
    }
  }
}

12:15:21.775 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:15:21.775 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.19.223.193"
      port: 34773
    }
    bound_http_address {
      host: "127.19.223.193"
      port: 43345
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.19.223.194"
      port: 44817
    }
    bound_http_address {
      host: "127.19.223.194"
      port: 44821
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.19.223.195"
      port: 41151
    }
    bound_http_address {
      host: "127.19.223.195"
      port: 37575
    }
  }
}

12:15:21.776 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:15:21.777 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:21.778 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:21.779 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:21.779 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.5.125:34511(127.19.5.125:34511)] Successfully connected to peer
12:15:21.783 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.125
12:15:21.793 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:21.795 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:21.798 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x39416574, L:/127.0.0.1:32874 - R:/127.19.5.125:34511] using SASL/PLAIN
12:15:21.802 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.5.124:34641(127.19.5.124:34641)] Successfully connected to peer
12:15:21.808 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.124
12:15:21.808 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.5.126:41267(127.19.5.126:41267)] Successfully connected to peer
12:15:21.812 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.126
12:15:21.829 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:21.830 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:21.833 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x70fd4e51, L:/127.0.0.1:34120 - R:/127.19.5.124:34641] using SASL/PLAIN
12:15:21.833 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xaf72848f, L:/127.0.0.1:41134 - R:/127.19.5.126:41267] using SASL/PLAIN
12:15:21.837 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:21.837 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [23ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: OK, deferred=null) after lookup
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.839041 19716 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34120:
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:21.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\004\001d\000\000\000\004\001\310\000\000\000"
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:21.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:21.842458 19716 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:15:21.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.887 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:21.893 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:21.894 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:21.894 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:21.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.895 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.895 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:21.895 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:21.895 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.895 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.895 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:21.896 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:21.951 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:21.952 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:21.952 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:21.952 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.952 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.952 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:21.953 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.953 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.953 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:21.953 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.953 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.953 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:21.953 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:21.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.962191 20274 tablet_service.cc:1511] Processing CreateTablet for tablet b056aa396cbb436e990ec90ba0e51d5b (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.964432 20274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b056aa396cbb436e990ec90ba0e51d5b. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:21.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.965884 20273 tablet_service.cc:1511] Processing CreateTablet for tablet b734e6fab27c4d5bb040bf1c1b00ac30 (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.973333 20275 tablet_service.cc:1511] Processing CreateTablet for tablet 07e34f4f54584c2e8db79b3792981f0c (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:21.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.974535 20273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b734e6fab27c4d5bb040bf1c1b00ac30. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:21.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:21.976116 20275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e34f4f54584c2e8db79b3792981f0c. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.010790 20133 tablet_service.cc:1511] Processing CreateTablet for tablet b734e6fab27c4d5bb040bf1c1b00ac30 (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:22.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.013106 20134 tablet_service.cc:1511] Processing CreateTablet for tablet b056aa396cbb436e990ec90ba0e51d5b (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:22.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.013262 19933 tablet_service.cc:1511] Processing CreateTablet for tablet b734e6fab27c4d5bb040bf1c1b00ac30 (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:22.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.014772 19934 tablet_service.cc:1511] Processing CreateTablet for tablet b056aa396cbb436e990ec90ba0e51d5b (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:22.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.015327 20133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b734e6fab27c4d5bb040bf1c1b00ac30. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.013267 19935 tablet_service.cc:1511] Processing CreateTablet for tablet 07e34f4f54584c2e8db79b3792981f0c (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:22.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.016952 19933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b734e6fab27c4d5bb040bf1c1b00ac30. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.018038 20134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b056aa396cbb436e990ec90ba0e51d5b. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.018884 19935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e34f4f54584c2e8db79b3792981f0c. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.020007 20135 tablet_service.cc:1511] Processing CreateTablet for tablet 07e34f4f54584c2e8db79b3792981f0c (DEFAULT_TABLE table=replication_test_table [id=0734908f759a4125b01da8e2ee88afa8]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:22.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.021116 20135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e34f4f54584c2e8db79b3792981f0c. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.019541 19934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b056aa396cbb436e990ec90ba0e51d5b. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:22.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.071636 21192 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Bootstrap starting.
12:15:22.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.080076 21193 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: Bootstrap starting.
12:15:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.083683 21192 tablet_bootstrap.cc:654] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Neither blocks nor log segments found. Creating new log.
12:15:22.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.086262 21192 log.cc:826] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Log is configured to *not* fsync() on all Append() calls
12:15:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.094578 21193 tablet_bootstrap.cc:654] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: Neither blocks nor log segments found. Creating new log.
12:15:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.097910 21193 log.cc:826] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: Log is configured to *not* fsync() on all Append() calls
12:15:22.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.103559 21192 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: No bootstrap required, opened a new log
12:15:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.104266 21192 ts_tablet_manager.cc:1403] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.005s
12:15:22.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.111199 21195 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Bootstrap starting.
12:15:22.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.126627 21193 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: No bootstrap required, opened a new log
12:15:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.127322 21193 ts_tablet_manager.cc:1403] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.011s
12:15:22.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.139153 21195 tablet_bootstrap.cc:654] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Neither blocks nor log segments found. Creating new log.
12:15:22.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.146791 21195 log.cc:826] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Log is configured to *not* fsync() on all Append() calls
12:15:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.160512 21195 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: No bootstrap required, opened a new log
12:15:22.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.161079 21195 ts_tablet_manager.cc:1403] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.012s
12:15:22.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.163203 21192 raft_consensus.cc:359] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.164247 21192 raft_consensus.cc:385] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.164609 21192 raft_consensus.cc:740] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3686b6a7f84623a8960571797785ee, State: Initialized, Role: FOLLOWER
12:15:22.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.165719 21192 consensus_queue.cc:260] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.169162 21193 raft_consensus.cc:359] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.170055 21193 raft_consensus.cc:385] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.170357 21193 raft_consensus.cc:740] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Initialized, Role: FOLLOWER
12:15:22.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.171319 21193 consensus_queue.cc:260] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.180528 21192 ts_tablet_manager.cc:1434] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Time spent starting tablet: real 0.076s	user 0.031s	sys 0.010s
12:15:22.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.183970 21193 ts_tablet_manager.cc:1434] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb: Time spent starting tablet: real 0.056s	user 0.023s	sys 0.015s
12:15:22.184 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:22.185 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:22.185 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:22.185 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.185 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.185 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.185 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.185 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.185 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.187 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.187 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.187 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.187 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:22.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.196875 21193 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: Bootstrap starting.
12:15:22.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.203033 21193 tablet_bootstrap.cc:654] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: Neither blocks nor log segments found. Creating new log.
12:15:22.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.209693 21192 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee: Bootstrap starting.
12:15:22.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.222259 21192 tablet_bootstrap.cc:654] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee: Neither blocks nor log segments found. Creating new log.
12:15:22.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.232847 21193 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: No bootstrap required, opened a new log
12:15:22.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.233353 21193 ts_tablet_manager.cc:1403] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.010s
12:15:22.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.235992 21193 raft_consensus.cc:359] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.235711 21195 raft_consensus.cc:359] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.236536 21193 raft_consensus.cc:385] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.236670 21195 raft_consensus.cc:385] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.236827 21193 raft_consensus.cc:740] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Initialized, Role: FOLLOWER
12:15:22.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.236990 21195 raft_consensus.cc:740] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431ead545e0a472b969830c473c49da6, State: Initialized, Role: FOLLOWER
12:15:22.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.237509 21193 consensus_queue.cc:260] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.240020 21193 ts_tablet_manager.cc:1434] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
12:15:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.240957 21193 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb: Bootstrap starting.
12:15:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.247264 21193 tablet_bootstrap.cc:654] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb: Neither blocks nor log segments found. Creating new log.
12:15:22.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.254361 21192 tablet_bootstrap.cc:492] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee: No bootstrap required, opened a new log
12:15:22.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.254916 21192 ts_tablet_manager.cc:1403] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.005s
12:15:22.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.238142 21195 consensus_queue.cc:260] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.258056 21192 raft_consensus.cc:359] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.258816 21192 raft_consensus.cc:385] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.259176 21192 raft_consensus.cc:740] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3686b6a7f84623a8960571797785ee, State: Initialized, Role: FOLLOWER
12:15:22.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.260125 21192 consensus_queue.cc:260] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.271574 21193 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb: No bootstrap required, opened a new log
12:15:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.271981 21193 ts_tablet_manager.cc:1403] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
12:15:22.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.274533 21193 raft_consensus.cc:359] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.275184 21193 raft_consensus.cc:385] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.275439 21193 raft_consensus.cc:740] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Initialized, Role: FOLLOWER
12:15:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.276100 21193 consensus_queue.cc:260] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.278024 21192 ts_tablet_manager.cc:1434] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
12:15:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.280560 21193 ts_tablet_manager.cc:1434] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
12:15:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.287267 21199 raft_consensus.cc:493] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.287814 21199 raft_consensus.cc:515] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.292932 21195 ts_tablet_manager.cc:1434] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Time spent starting tablet: real 0.132s	user 0.047s	sys 0.006s
12:15:22.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.294163 21195 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6: Bootstrap starting.
12:15:22.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.301700 21195 tablet_bootstrap.cc:654] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6: Neither blocks nor log segments found. Creating new log.
12:15:22.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.303666 21199 leader_election.cc:290] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845), 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:22.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.315215 21195 tablet_bootstrap.cc:492] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6: No bootstrap required, opened a new log
12:15:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.315613 21195 ts_tablet_manager.cc:1403] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
12:15:22.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.316358 20207 tablet.cc:2406] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:22.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.323166 21195 raft_consensus.cc:359] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.325002 21195 raft_consensus.cc:385] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.325627 21195 raft_consensus.cc:740] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431ead545e0a472b969830c473c49da6, State: Initialized, Role: FOLLOWER
12:15:22.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.327584 21195 consensus_queue.cc:260] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.330161 21195 ts_tablet_manager.cc:1434] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
12:15:22.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.331333 21195 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6: Bootstrap starting.
12:15:22.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.339362 21195 tablet_bootstrap.cc:654] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6: Neither blocks nor log segments found. Creating new log.
12:15:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.342303 21192 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee: Bootstrap starting.
12:15:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.346042 20347 tablet.cc:2406] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:22.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.352123 21195 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6: No bootstrap required, opened a new log
12:15:22.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.352743 21195 ts_tablet_manager.cc:1403] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
12:15:22.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.355619 21195 raft_consensus.cc:359] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.356455 21195 raft_consensus.cc:385] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.356858 21195 raft_consensus.cc:740] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431ead545e0a472b969830c473c49da6, State: Initialized, Role: FOLLOWER
12:15:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.357877 21195 consensus_queue.cc:260] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.360334 21195 ts_tablet_manager.cc:1434] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
12:15:22.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.367739 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee" is_pre_election: true
12:15:22.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.369694 19889 leader_election.cc:343] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719): Illegal state: must be running to vote when last-logged opid is not known
12:15:22.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.371385 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6" is_pre_election: true
12:15:22.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.372239 20155 raft_consensus.cc:2468] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 0.
12:15:22.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.373687 19888 leader_election.cc:304] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 431ead545e0a472b969830c473c49da6, ef7bb15de6bf4075800485dce5d135bb; no voters: 2f3686b6a7f84623a8960571797785ee
12:15:22.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.374406 21199 raft_consensus.cc:2804] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:22.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.374723 21199 raft_consensus.cc:493] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:22.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.375018 21199 raft_consensus.cc:3060] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Advancing to term 1
12:15:22.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.382030 21199 raft_consensus.cc:515] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.383814 21192 tablet_bootstrap.cc:654] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee: Neither blocks nor log segments found. Creating new log.
12:15:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.385350 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:22.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.386731 19889 leader_election.cc:343] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719): Illegal state: must be running to vote when last-logged opid is not known
12:15:22.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.387589 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6"
12:15:22.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.388091 20155 raft_consensus.cc:3060] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Advancing to term 1
12:15:22.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.395074 21199 leader_election.cc:290] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Requested vote from peers 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845), 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:22.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.395869 20155 raft_consensus.cc:2468] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 1.
12:15:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.397333 19888 leader_election.cc:304] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 431ead545e0a472b969830c473c49da6, ef7bb15de6bf4075800485dce5d135bb; no voters: 2f3686b6a7f84623a8960571797785ee
12:15:22.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.398057 21199 raft_consensus.cc:2804] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Leader election won for term 1
12:15:22.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.405716 21192 tablet_bootstrap.cc:492] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee: No bootstrap required, opened a new log
12:15:22.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.406179 21192 ts_tablet_manager.cc:1403] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.004s
12:15:22.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.413684 21192 raft_consensus.cc:359] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.414857 21192 raft_consensus.cc:385] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:22.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.415129 21192 raft_consensus.cc:740] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3686b6a7f84623a8960571797785ee, State: Initialized, Role: FOLLOWER
12:15:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.416525 21210 raft_consensus.cc:493] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.416944 20005 tablet.cc:2406] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:22.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.415784 21192 consensus_queue.cc:260] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.420941 21192 ts_tablet_manager.cc:1434] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
12:15:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.417415 21210 raft_consensus.cc:515] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.425644 21199 raft_consensus.cc:697] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [term 1 LEADER]: Becoming Leader. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Running, Role: LEADER
12:15:22.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.426887 21199 consensus_queue.cc:237] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.428411 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b734e6fab27c4d5bb040bf1c1b00ac30" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6" is_pre_election: true
12:15:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.429057 20155 raft_consensus.cc:2468] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 0.
12:15:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.430121 19888 leader_election.cc:304] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431ead545e0a472b969830c473c49da6, ef7bb15de6bf4075800485dce5d135bb; no voters: 
12:15:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.432298 21209 raft_consensus.cc:2804] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:22.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.433849 21210 leader_election.cc:290] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845), 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:22.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.434882 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b734e6fab27c4d5bb040bf1c1b00ac30" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee" is_pre_election: true
12:15:22.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.433701 21209 raft_consensus.cc:493] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:22.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.435685 21209 raft_consensus.cc:3060] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Advancing to term 1
12:15:22.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.435622 20295 raft_consensus.cc:2468] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 0.
12:15:22.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.444589 21210 raft_consensus.cc:493] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:22.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.445204 21210 raft_consensus.cc:515] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.450119 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e34f4f54584c2e8db79b3792981f0c" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee" is_pre_election: true
12:15:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.450663 20295 raft_consensus.cc:2468] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 0.
12:15:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.451560 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e34f4f54584c2e8db79b3792981f0c" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6" is_pre_election: true
12:15:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.452117 20155 raft_consensus.cc:2468] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 0.
12:15:22.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.447556 21210 leader_election.cc:290] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719), 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:22.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.455317 19888 leader_election.cc:304] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431ead545e0a472b969830c473c49da6, ef7bb15de6bf4075800485dce5d135bb; no voters: 
12:15:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.457412 21210 raft_consensus.cc:2804] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:22.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.457908 21210 raft_consensus.cc:493] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:22.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.458371 21210 raft_consensus.cc:3060] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 0 FOLLOWER]: Advancing to term 1
12:15:22.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.463560 19715 catalog_manager.cc:5697] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7bb15de6bf4075800485dce5d135bb (127.19.5.65). New cstate: current_term: 1 leader_uuid: "ef7bb15de6bf4075800485dce5d135bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } health_report { overall_health: UNKNOWN } } }
12:15:22.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.466192 21210 raft_consensus.cc:515] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.472538 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e34f4f54584c2e8db79b3792981f0c" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.473112 20295 raft_consensus.cc:3060] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Advancing to term 1
12:15:22.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.484524 20295 raft_consensus.cc:2468] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 1.
12:15:22.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.486280 19889 leader_election.cc:304] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3686b6a7f84623a8960571797785ee, ef7bb15de6bf4075800485dce5d135bb; no voters: 
12:15:22.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.487035 21199 raft_consensus.cc:2804] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Leader election won for term 1
12:15:22.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.491518 21209 raft_consensus.cc:515] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.493883 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e34f4f54584c2e8db79b3792981f0c" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6"
12:15:22.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.494390 20155 raft_consensus.cc:3060] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Advancing to term 1
12:15:22.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.501009 20155 raft_consensus.cc:2468] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 1.
12:15:22.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.496733 21199 raft_consensus.cc:697] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [term 1 LEADER]: Becoming Leader. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Running, Role: LEADER
12:15:22.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.503683 21199 consensus_queue.cc:237] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } }
12:15:22.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.502657 21210 leader_election.cc:290] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Requested vote from peers 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719), 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:22.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.512271 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b734e6fab27c4d5bb040bf1c1b00ac30" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6"
12:15:22.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.512917 20155 raft_consensus.cc:3060] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 0 FOLLOWER]: Advancing to term 1
12:15:22.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.516835 21209 leader_election.cc:290] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Requested vote from peers 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845), 2f3686b6a7f84623a8960571797785ee (127.19.5.67:38719)
12:15:22.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.518091 20295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b734e6fab27c4d5bb040bf1c1b00ac30" candidate_uuid: "ef7bb15de6bf4075800485dce5d135bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3686b6a7f84623a8960571797785ee"
12:15:22.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.519773 20295 raft_consensus.cc:3060] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Advancing to term 1
12:15:22.525 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:22.525 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:22.526 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:22.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.527 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.527 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.527 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.527 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:22.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.522075 19715 catalog_manager.cc:5697] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7bb15de6bf4075800485dce5d135bb (127.19.5.65). New cstate: current_term: 1 leader_uuid: "ef7bb15de6bf4075800485dce5d135bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } health_report { overall_health: HEALTHY } } }
12:15:22.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.530364 20155 raft_consensus.cc:2468] T b734e6fab27c4d5bb040bf1c1b00ac30 P 431ead545e0a472b969830c473c49da6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 1.
12:15:22.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.531711 20295 raft_consensus.cc:2468] T b734e6fab27c4d5bb040bf1c1b00ac30 P 2f3686b6a7f84623a8960571797785ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7bb15de6bf4075800485dce5d135bb in term 1.
12:15:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.532790 19889 leader_election.cc:304] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f3686b6a7f84623a8960571797785ee, ef7bb15de6bf4075800485dce5d135bb; no voters: 
12:15:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.533516 21199 raft_consensus.cc:2804] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 1 FOLLOWER]: Leader election won for term 1
12:15:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.533955 21199 raft_consensus.cc:697] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [term 1 LEADER]: Becoming Leader. State: Replica: ef7bb15de6bf4075800485dce5d135bb, State: Running, Role: LEADER
12:15:22.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.534675 21199 consensus_queue.cc:237] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:22.548589 20427 debug-util.cc:398] Leaking SignalData structure 0x7b080009db20 after lost signal to thread 20364
12:15:22.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.555503 19715 catalog_manager.cc:5697] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7bb15de6bf4075800485dce5d135bb (127.19.5.65). New cstate: current_term: 1 leader_uuid: "ef7bb15de6bf4075800485dce5d135bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } health_report { overall_health: UNKNOWN } } }
12:15:22.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.593451 21198 raft_consensus.cc:493] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:22.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.593921 21198 raft_consensus.cc:515] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7bb15de6bf4075800485dce5d135bb" member_type: VOTER last_known_addr { host: "127.19.5.65" port: 45925 } } peers { permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 } } peers { permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 } }
12:15:22.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.596961 21198 leader_election.cc:290] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7bb15de6bf4075800485dce5d135bb (127.19.5.65:45925), 431ead545e0a472b969830c473c49da6 (127.19.5.66:38845)
12:15:22.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.618264 19955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "2f3686b6a7f84623a8960571797785ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7bb15de6bf4075800485dce5d135bb" is_pre_election: true
12:15:22.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.621649 20155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b056aa396cbb436e990ec90ba0e51d5b" candidate_uuid: "2f3686b6a7f84623a8960571797785ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431ead545e0a472b969830c473c49da6" is_pre_election: true
12:15:22.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.622268 20155 raft_consensus.cc:2393] T b056aa396cbb436e990ec90ba0e51d5b P 431ead545e0a472b969830c473c49da6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f3686b6a7f84623a8960571797785ee in current term 1: Already voted for candidate ef7bb15de6bf4075800485dce5d135bb in this term.
12:15:22.623 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:22.623 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:22.624 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:22.624 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.624 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.624 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.624 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:22.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.623363 20228 leader_election.cc:304] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f3686b6a7f84623a8960571797785ee; no voters: 431ead545e0a472b969830c473c49da6, ef7bb15de6bf4075800485dce5d135bb
12:15:22.625 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.624 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.625 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.625 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:22.625 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:22.625 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:22.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.625545 21198 raft_consensus.cc:3060] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 0 FOLLOWER]: Advancing to term 1
12:15:22.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.631786 21198 raft_consensus.cc:2749] T b056aa396cbb436e990ec90ba0e51d5b P 2f3686b6a7f84623a8960571797785ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:15:22.633 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:22.633 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:22.633 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:22.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:22.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:22.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:22.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:22.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:22.633 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:22.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:22.633 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:22.633 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:22.633 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:22.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:22.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:22.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:22.668 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:22.669 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:22.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:22.669 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:22.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:22.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:22.669 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:22.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:22.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:22.669 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:22.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:22.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:22.686 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:22.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.687 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.687 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.687 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.688 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:22.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.711 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:22.712 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:22.712 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:22.712 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:22.712 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:22.712 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:22.712 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:22.712 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:22.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:22.712 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:22.712 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:22.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:22.712 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:22.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.750706 21159 heartbeater.cc:499] Master 127.19.223.252:41911 was elected leader, sending a full tablet report...
12:15:22.773 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:22.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.773 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:22.773 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:22.774 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.774 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.774 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:22.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.774 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.774 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:22.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:22.775 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:22.804 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:22.808 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 07e34f4f54584c2e8db79b3792981f0c for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:22.808 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b056aa396cbb436e990ec90ba0e51d5b for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:22.808 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b734e6fab27c4d5bb040bf1c1b00ac30 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:22.808 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:22.808 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.19.5.124:34641, [3ms] Sub RPC GetTableLocations: received response from server master-127.19.5.124:34641: OK, deferred=null) after lookup
12:15:22.808 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)] connecting to peer
12:15:22.809 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)] Successfully connected to peer
12:15:22.818 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:22.821 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x10657d47, L:/127.0.0.1:59346 - R:/127.19.5.65:45925] using TOKEN/null
12:15:22.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.833707 20295 raft_consensus.cc:1275] T 07e34f4f54584c2e8db79b3792981f0c P 2f3686b6a7f84623a8960571797785ee [term 1 FOLLOWER]: Refusing update from remote peer ef7bb15de6bf4075800485dce5d135bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:22.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.833765 20155 raft_consensus.cc:1275] T 07e34f4f54584c2e8db79b3792981f0c P 431ead545e0a472b969830c473c49da6 [term 1 FOLLOWER]: Refusing update from remote peer ef7bb15de6bf4075800485dce5d135bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:22.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.835131 21209 consensus_queue.cc:1048] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:22.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.835866 21199 consensus_queue.cc:1048] T 07e34f4f54584c2e8db79b3792981f0c P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:22.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.844627 21199 consensus_queue.cc:1048] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:15:22.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:22.875 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:22.875 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:22.875 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:22.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:22.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:22.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:22.877 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:22.877 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:22.877 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:22.877 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:22.877 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:22.877 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:22.877 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:22.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.879478 21227 mvcc.cc:204] Tried to move back new op lower bound from 7305268931911946240 to 7305268930584866816. Current Snapshot: MvccSnapshot[applied={T|T < 7305268931911946240}]
12:15:22.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.888571 21228 mvcc.cc:204] Tried to move back new op lower bound from 7305268931911946240 to 7305268930584866816. Current Snapshot: MvccSnapshot[applied={T|T < 7305268931911946240}]
12:15:22.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:22.905144 21218 consensus_queue.cc:1048] T b056aa396cbb436e990ec90ba0e51d5b P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:15:22.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.045426 21210 consensus_queue.cc:1048] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "431ead545e0a472b969830c473c49da6" member_type: VOTER last_known_addr { host: "127.19.5.66" port: 38845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:23.050 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:23.050 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:23.050 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:23.051 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:23.051 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:23.051 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:23.051 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:23.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:23.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:23.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:23.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:23.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:23.052 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:23.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.114430 21209 consensus_queue.cc:1048] T b734e6fab27c4d5bb040bf1c1b00ac30 P ef7bb15de6bf4075800485dce5d135bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3686b6a7f84623a8960571797785ee" member_type: VOTER last_known_addr { host: "127.19.5.67" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:15:23.121 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:23.121 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:23.121 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:23.122 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.122 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.122 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.122 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.122 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.123 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.124 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.125 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.125 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.125 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:23.153 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:23.153 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:23.153 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:23.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.156 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.156 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.157 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:23.191 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.332 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:23.333 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:23.335 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:23.337 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:23.338 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:23.340 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:23.342 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:23.345 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:23.348 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:23.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.359 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.366 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xabd5f60c, L:/127.0.0.1:46028 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:23.372 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:23.378 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:23.378 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:23.379 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:23.379 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.379 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.379 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.380 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.380 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.380 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.380 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.380 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.380 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.380 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:23.382 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.386 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xe958247b, L:/127.0.0.1:40942 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:23.392 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:23.403 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.406 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7b9b0abb, L:/127.0.0.1:41626 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:23.411 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:23.411 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=76), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [35ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: OK, [75ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:23.414 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:23.415 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:23.423 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.5.125:34511(127.19.5.125:34511)] Successfully connected to peer
12:15:23.424 [DEBUG - main] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:23.429 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.5.124:34641(127.19.5.124:34641)] Successfully connected to peer
12:15:23.431 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.125
12:15:23.435 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.124
12:15:23.441 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.445 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2589436d, L:/127.0.0.1:32886 - R:/127.19.5.125:34511] using SASL/PLAIN
12:15:23.450 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.452 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.5.126:41267(127.19.5.126:41267)] Successfully connected to peer
12:15:23.453 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xc395582c, L:/127.0.0.1:34134 - R:/127.19.5.124:34641] using SASL/PLAIN
12:15:23.456 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:23.456 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=42), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [35ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: OK, deferred=null) after lookup
12:15:23.457 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.126
12:15:23.461 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:23.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.465 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 07e34f4f54584c2e8db79b3792981f0c for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:23.465 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b056aa396cbb436e990ec90ba0e51d5b for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:23.465 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b734e6fab27c4d5bb040bf1c1b00ac30 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:23.465 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.468140 20554 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41626:
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:23.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\001d\000\000\000"
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:15:23.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:15:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:23.473878 20554 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:15:23.487 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:23.495 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x34b2a8cc, L:/127.0.0.1:41150 - R:/127.19.5.126:41267] using SASL/PLAIN
12:15:23.591 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:23.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.660024 20782 tablet_service.cc:1511] Processing CreateTablet for tablet a812d211a3744a15bae682bb9b5592f5 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:23.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.662846 20782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a812d211a3744a15bae682bb9b5592f5. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:23.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.670322 20952 tablet_service.cc:1511] Processing CreateTablet for tablet a812d211a3744a15bae682bb9b5592f5 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:23.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.672398 20952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a812d211a3744a15bae682bb9b5592f5. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:23.690 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.706656 21094 tablet_service.cc:1511] Processing CreateTablet for tablet a812d211a3744a15bae682bb9b5592f5 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION VALUES < 100
12:15:23.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.709201 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a812d211a3744a15bae682bb9b5592f5. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:23.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.740585 21273 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Bootstrap starting.
12:15:23.742 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:23.742 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:23.742 [DEBUG - pool-242-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:23.742 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.742 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.743 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:23.743 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.743 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.743 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:23.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:23.743 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:23.744 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29156), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [15ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [16ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [16ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [22ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [23ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [27ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [41ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [43ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [65ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [702ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [702ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [962ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [963ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [963ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [963ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2040ms] refreshing cache from master, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2042ms] too many traces: truncated at 100 traces, deferred=Deferred@1168355410(state=PENDING, result=null, callback=(continuation of Deferred@1756613405 after retry RPC after error@992881530) -> (continuation of Deferred@1113235653 after retry RPC after error@438548988) -> (continuation of Deferred@1816027782 after retry RPC after error@637657472) -> (continuation of Deferred@826945805 after retry RPC after error@908165761) -> (continuation of Deferred@697625745 after retry RPC after error@11535810) -> (continuation of Deferred@1611832960 after retry RPC after error@1520250249) -> (continuation of Deferred@1424204335 after retry RPC after error@1425875812) -> (continuation of Deferred@552550885 after retry RPC after error@321769748) -> (continuation of Deferred@1519844228 after retry RPC after error@1733105073) -> (continuation of Deferred@1039634644 after retry RPC after error@1076839183) -> (continuation of Deferred@763943509 after retry RPC after error@577221320) -> (continuation of Deferred@597157728 after retry RPC after error@429584166) -> (continuation of Deferred@1915470898 after retry RPC after error@1833294157) -> (continuation of Deferred@1903533922 after retry RPC after error@1062780341) -> (continuation of Deferred@335471672 after retry RPC after error@1345505467) -> (continuation of Deferred@232903504 after retry RPC after error@2007917132) -> (continuation of Deferred@320182181 after retry RPC after error@1428484716) -> (continuation of Deferred@1457311947 after retry RPC after error@1382315102) -> (continuation of Deferred@1836284168 after retry RPC after error@532042072) -> (continuation of Deferred@802980077 after retry RPC after error@1592510412) -> (continuation of Deferred@681991712 after retry RPC after error@87553789) -> (continuation of Deferred@1311233374 after retry RPC after error@1316138737) -> (continuation of Deferred@1413463617 after retry RPC after error@1854224933) -> (continuation of Deferred@511217550 after retry RPC after error@1160167318) -> (continuation of Deferred@1824709829 after retry RPC after error@726763370), errback=(continuation of Deferred@1756613405 after retry RPC after error@992881530) -> (continuation of Deferred@1113235653 after retry RPC after error@438548988) -> (continuation of Deferred@1816027782 after retry RPC after error@637657472) -> (continuation of Deferred@826945805 after retry RPC after error@908165761) -> (continuation of Deferred@697625745 after retry RPC after error@11535810) -> (continuation of Deferred@1611832960 after retry RPC after error@1520250249) -> (continuation of Deferred@1424204335 after retry RPC after error@1425875812) -> (continuation of Deferred@552550885 after retry RPC after error@321769748) -> (continuation of Deferred@1519844228 after retry RPC after error@1733105073) -> (continuation of Deferred@1039634644 after retry RPC after error@1076839183) -> (continuation of Deferred@763943509 after retry RPC after error@577221320) -> (continuation of Deferred@597157728 after retry RPC after error@429584166) -> (continuation of Deferred@1915470898 after retry RPC after error@1833294157) -> (continuation of Deferred@1903533922 after retry RPC after error@1062780341) -> (continuation of Deferred@335471672 after retry RPC after error@1345505467) -> (continuation of Deferred@232903504 after retry RPC after error@2007917132) -> (continuation of Deferred@320182181 after retry RPC after error@1428484716) -> (continuation of Deferred@1457311947 after retry RPC after error@1382315102) -> (continuation of Deferred@1836284168 after retry RPC after error@532042072) -> (continuation of Deferred@802980077 after retry RPC after error@1592510412) -> (continuation of Deferred@681991712 after retry RPC after error@87553789) -> (continuation of Deferred@1311233374 after retry RPC after error@1316138737) -> (continuation of Deferred@1413463617 after retry RPC after error@1854224933) -> (continuation of Deferred@511217550 after retry RPC after error@1160167318) -> (continuation of Deferred@1824709829 after retry RPC after error@726763370)))
12:15:23.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.753963 21273 tablet_bootstrap.cc:654] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Neither blocks nor log segments found. Creating new log.
12:15:23.756 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:23.756 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:23.756 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:23.756 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.756 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.756 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.757 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.757 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.757 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.757 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.757 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.757 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.757 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:23.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.764303 21273 log.cc:826] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Log is configured to *not* fsync() on all Append() calls
12:15:23.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.777828 21273 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: No bootstrap required, opened a new log
12:15:23.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.778432 21273 ts_tablet_manager.cc:1403] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.007s
12:15:23.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.796382 21276 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Bootstrap starting.
12:15:23.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.807293 21273 raft_consensus.cc:359] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.808476 21273 raft_consensus.cc:385] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:23.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.808802 21273 raft_consensus.cc:740] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8405c6dcf75f4c55821f8d76dd841e8a, State: Initialized, Role: FOLLOWER
12:15:23.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.809324 21276 tablet_bootstrap.cc:654] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Neither blocks nor log segments found. Creating new log.
12:15:23.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.809834 21273 consensus_queue.cc:260] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.811662 21276 log.cc:826] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Log is configured to *not* fsync() on all Append() calls
12:15:23.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.813269 21277 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Bootstrap starting.
12:15:23.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.823282 21273 ts_tablet_manager.cc:1434] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent starting tablet: real 0.045s	user 0.034s	sys 0.005s
12:15:23.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.824808 21276 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: No bootstrap required, opened a new log
12:15:23.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.825431 21276 ts_tablet_manager.cc:1403] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.000s
12:15:23.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.831135 21277 tablet_bootstrap.cc:654] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Neither blocks nor log segments found. Creating new log.
12:15:23.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.833349 21277 log.cc:826] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Log is configured to *not* fsync() on all Append() calls
12:15:23.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.851199 21277 tablet_bootstrap.cc:492] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: No bootstrap required, opened a new log
12:15:23.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.851888 21277 ts_tablet_manager.cc:1403] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.007s
12:15:23.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.858736 21276 raft_consensus.cc:359] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.859413 21276 raft_consensus.cc:385] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.859686 21276 raft_consensus.cc:740] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Initialized, Role: FOLLOWER
12:15:23.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.860427 21276 consensus_queue.cc:260] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.863883 21276 ts_tablet_manager.cc:1434] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.014s
12:15:23.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.889143 21281 raft_consensus.cc:493] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.889794 21281 raft_consensus.cc:515] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.893378 21281 leader_election.cc:290] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:23.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.915544 21277 raft_consensus.cc:359] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.920 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:23.920 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:23.920 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:23.920 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.920 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.920 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:23.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.921 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.921 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:23.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:23.921 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:23.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.922838 21277 raft_consensus.cc:385] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:23.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.923090 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a812d211a3744a15bae682bb9b5592f5" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b" is_pre_election: true
12:15:23.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.923300 21277 raft_consensus.cc:740] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a70185538824df48992807d60b77e4b, State: Initialized, Role: FOLLOWER
12:15:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.924665 20802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a812d211a3744a15bae682bb9b5592f5" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" is_pre_election: true
12:15:23.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.924885 21277 consensus_queue.cc:260] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.925588 20802 raft_consensus.cc:2468] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:23.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.927567 21114 raft_consensus.cc:2468] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:23.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.932294 20908 leader_election.cc:304] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:23.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.933508 21281 raft_consensus.cc:2804] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.933856 21281 raft_consensus.cc:493] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.934160 21281 raft_consensus.cc:3060] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Advancing to term 1
12:15:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.941175 21281 raft_consensus.cc:515] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.943444 21281 leader_election.cc:290] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Requested vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.944192 20802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a812d211a3744a15bae682bb9b5592f5" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.944562 20802 raft_consensus.cc:3060] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Advancing to term 1
12:15:23.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.948319 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a812d211a3744a15bae682bb9b5592f5" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b"
12:15:23.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.948863 21114 raft_consensus.cc:3060] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Advancing to term 1
12:15:23.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.957703 20802 raft_consensus.cc:2468] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:23.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.958807 21277 ts_tablet_manager.cc:1434] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Time spent starting tablet: real 0.107s	user 0.029s	sys 0.013s
12:15:23.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.958841 20908 leader_election.cc:304] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:23.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.960672 21114 raft_consensus.cc:2468] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:23.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.962306 21281 raft_consensus.cc:2804] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Leader election won for term 1
12:15:23.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:23.967 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:23.968 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:23.968 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:23.968 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:23.968 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:23.968 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:23.968 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:23.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:23.968 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:23.968 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:23.969 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:23.969 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:23.969 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:23.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:23.983683 21164 tablet.cc:2406] T a812d211a3744a15bae682bb9b5592f5 P 6a70185538824df48992807d60b77e4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:23.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.990579 21281 raft_consensus.cc:697] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [term 1 LEADER]: Becoming Leader. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Running, Role: LEADER
12:15:23.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:23.991801 21281 consensus_queue.cc:237] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } }
12:15:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:23.995369 20855 tablet.cc:2406] T a812d211a3744a15bae682bb9b5592f5 P 8405c6dcf75f4c55821f8d76dd841e8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:24.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.005085 20554 catalog_manager.cc:5697] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac51161fda3d472ab4a07ec520f694dc (127.19.223.194). New cstate: current_term: 1 leader_uuid: "ac51161fda3d472ab4a07ec520f694dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } health_report { overall_health: HEALTHY } } }
12:15:24.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.061213 20554 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41626:
12:15:24.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001d\000\000\000\007\001\310\000\000\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
12:15:24.077 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:24.077 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:24.078 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:24.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.078 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.078 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.078 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.078 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:24.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:24.092098 21024 tablet.cc:2406] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:24.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:24.102152 20554 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 657dee8f9cfb4ce992876c093ff02768 has no consensus state
12:15:24.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.123940 20782 tablet_service.cc:1511] Processing CreateTablet for tablet 657dee8f9cfb4ce992876c093ff02768 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:24.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.125190 20782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657dee8f9cfb4ce992876c093ff02768. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.132510 20952 tablet_service.cc:1511] Processing CreateTablet for tablet 657dee8f9cfb4ce992876c093ff02768 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:24.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.134661 20952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657dee8f9cfb4ce992876c093ff02768. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:24.136512 20539 catalog_manager.cc:4810] Async tablet task AlterTable RPC for tablet 657dee8f9cfb4ce992876c093ff02768 (table replication_test_table [id=cee5e91d959f4024be25f1424343d851], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 657dee8f9cfb4ce992876c093ff02768 consensus state has no leader
12:15:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.140564 21273 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a: Bootstrap starting.
12:15:24.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.147475 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 657dee8f9cfb4ce992876c093ff02768 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 100 <= VALUES < 200
12:15:24.161 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:24.161 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:24.161 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:24.161 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.161 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.161 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.161346 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657dee8f9cfb4ce992876c093ff02768. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.162 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.162 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.162 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.162 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.162 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.162 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.162 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:24.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.170571 21273 tablet_bootstrap.cc:654] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a: Neither blocks nor log segments found. Creating new log.
12:15:24.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.171315 21276 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc: Bootstrap starting.
12:15:24.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.176992 21276 tablet_bootstrap.cc:654] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc: Neither blocks nor log segments found. Creating new log.
12:15:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.190207 21273 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a: No bootstrap required, opened a new log
12:15:24.191 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.190629 21273 ts_tablet_manager.cc:1403] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
12:15:24.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.195533 21276 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc: No bootstrap required, opened a new log
12:15:24.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.196081 21276 ts_tablet_manager.cc:1403] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
12:15:24.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.195996 21273 raft_consensus.cc:359] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.196813 21273 raft_consensus.cc:385] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.197120 21273 raft_consensus.cc:740] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8405c6dcf75f4c55821f8d76dd841e8a, State: Initialized, Role: FOLLOWER
12:15:24.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.197803 21273 consensus_queue.cc:260] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.199517 21277 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b: Bootstrap starting.
12:15:24.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.212356 21277 tablet_bootstrap.cc:654] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b: Neither blocks nor log segments found. Creating new log.
12:15:24.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.217563 21273 ts_tablet_manager.cc:1434] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
12:15:24.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.220593 20554 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: replication_test_table [id=cee5e91d959f4024be25f1424343d851] alter complete (version 0)
12:15:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.222877 21277 tablet_bootstrap.cc:492] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b: No bootstrap required, opened a new log
12:15:24.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.223294 21277 ts_tablet_manager.cc:1403] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.004s
12:15:24.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.226150 21277 raft_consensus.cc:359] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.226845 21277 raft_consensus.cc:385] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.227099 21277 raft_consensus.cc:740] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a70185538824df48992807d60b77e4b, State: Initialized, Role: FOLLOWER
12:15:24.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.227856 21277 consensus_queue.cc:260] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.232739 21276 raft_consensus.cc:359] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.234043 21276 raft_consensus.cc:385] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.234336 21276 raft_consensus.cc:740] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Initialized, Role: FOLLOWER
12:15:24.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.235124 21276 consensus_queue.cc:260] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.241703 21277 ts_tablet_manager.cc:1434] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
12:15:24.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.243727 21281 raft_consensus.cc:493] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:24.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.244138 21281 raft_consensus.cc:515] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.246 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:24.246 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:24.246 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:24.247 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.247 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.247 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.247 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.246330 21281 leader_election.cc:290] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:24.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.247 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.247 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.248 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.248 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.248 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:24.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.248379 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657dee8f9cfb4ce992876c093ff02768" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b" is_pre_election: true
12:15:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.248941 21114 raft_consensus.cc:2468] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:24.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.251722 20802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657dee8f9cfb4ce992876c093ff02768" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" is_pre_election: true
12:15:24.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.252315 20802 raft_consensus.cc:2468] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:24.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.254830 20908 leader_election.cc:304] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:24.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.256917 21276 ts_tablet_manager.cc:1434] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.004s
12:15:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.259564 21281 raft_consensus.cc:2804] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:24.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.259898 21281 raft_consensus.cc:493] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:24.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.260164 21281 raft_consensus.cc:3060] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Advancing to term 1
12:15:24.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.265908 20553 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41626:
12:15:24.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "replication_test_table" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "<redacted>""\006\001\310\000\000\000\007\000" } } } schema { columns { name: "key1" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key2" type: STRING is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "key3" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } columns { name: "data" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false is_auto_incrementing: false } }
12:15:24.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.268894 21281 raft_consensus.cc:515] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.271843 21281 leader_election.cc:290] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Requested vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:24.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:24.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:24.273 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.273113 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657dee8f9cfb4ce992876c093ff02768" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b"
12:15:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.273607 21114 raft_consensus.cc:3060] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Advancing to term 1
12:15:24.273 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:24.273 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:24.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:24.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:24.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:24.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:24.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.273591 20802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657dee8f9cfb4ce992876c093ff02768" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:24.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.274121 20802 raft_consensus.cc:3060] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Advancing to term 1
12:15:24.277 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:24.277 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:24.277 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:24.277 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:24.282 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:24.282 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:24.282 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:24.282 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.282 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.283 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:24.283 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.283 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.283 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.281845 21114 raft_consensus.cc:2468] T 657dee8f9cfb4ce992876c093ff02768 P 6a70185538824df48992807d60b77e4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.282938 20908 leader_election.cc:304] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a70185538824df48992807d60b77e4b, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:24.284 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.284 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.284 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:24.284 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.283931 21281 raft_consensus.cc:2804] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Leader election won for term 1
12:15:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.284520 21281 raft_consensus.cc:697] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [term 1 LEADER]: Becoming Leader. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Running, Role: LEADER
12:15:24.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.285455 21281 consensus_queue.cc:237] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.283723 20802 raft_consensus.cc:2468] T 657dee8f9cfb4ce992876c093ff02768 P 8405c6dcf75f4c55821f8d76dd841e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:24.326 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:24.326 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:24.326 [DEBUG - pool-246-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:24.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:24.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:24.328 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.328 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.328 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:24.328 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:24.329 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29728), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [13ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [14ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [15ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [27ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [28ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [29ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [29ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [63ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [64ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [64ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [83ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [89ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [222ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [400ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [400ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [542ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [542ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [542ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [542ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [921ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [921ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [921ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [922ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3180ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3182ms] too many traces: truncated at 100 traces, deferred=Deferred@1281295951(state=PENDING, result=null, callback=(continuation of Deferred@1617452954 after retry RPC after error@1179925068) -> (continuation of Deferred@1504424210 after retry RPC after error@1836230934) -> (continuation of Deferred@1338290093 after retry RPC after error@673540675) -> (continuation of Deferred@738360692 after retry RPC after error@1413499899) -> (continuation of Deferred@1041444633 after retry RPC after error@1038560746) -> (continuation of Deferred@45158143 after retry RPC after error@1417183937) -> (continuation of Deferred@1941181616 after retry RPC after error@2008608593) -> (continuation of Deferred@2113192367 after retry RPC after error@1837771354) -> (continuation of Deferred@1044947663 after retry RPC after error@247074864) -> (continuation of Deferred@1436041713 after retry RPC after error@1769761250) -> (continuation of Deferred@316268760 after retry RPC after error@1287412003) -> (continuation of Deferred@1539055244 after retry RPC after error@1359306592) -> (continuation of Deferred@210221752 after retry RPC after error@584884042) -> (continuation of Deferred@422559203 after retry RPC after error@1646927865) -> (continuation of Deferred@1405692798 after retry RPC after error@363448450) -> (continuation of Deferred@1896722289 after retry RPC after error@1131062142) -> (continuation of Deferred@1508045494 after retry RPC after error@39115984) -> (continuation of Deferred@507420108 after retry RPC after error@148483110) -> (continuation of Deferred@1180735689 after retry RPC after error@1660317321) -> (continuation of Deferred@139223014 after retry RPC after error@1295084117) -> (continuation of Deferred@257234410 after retry RPC after error@1585881263) -> (continuation of Deferred@887056374 after retry RPC after error@1920647418) -> (continuation of Deferred@1437032730 after retry RPC after error@1053761753) -> (continuation of Deferred@1910509601 after retry RPC after error@1438213111) -> (continuation of Deferred@1006135275 after retry RPC after error@2088124837) -> (continuation of Deferred@233191186 after retry RPC after error@324950914) -> (continuation of Deferred@1801564477 after retry RPC after error@634695325) -> (continuation of Deferred@422986642 after retry RPC after error@2027260285) -> (continuation of Deferred@509294339 after retry RPC after error@519819795), errback=(continuation of Deferred@1617452954 after retry RPC after error@1179925068) -> (continuation of Deferred@1504424210 after retry RPC after error@1836230934) -> (continuation of Deferred@1338290093 after retry RPC after error@673540675) -> (continuation of Deferred@738360692 after retry RPC after error@1413499899) -> (continuation of Deferred@1041444633 after retry RPC after error@1038560746) -> (continuation of Deferred@45158143 after retry RPC after error@1417183937) -> (continuation of Deferred@1941181616 after retry RPC after error@2008608593) -> (continuation of Deferred@2113192367 after retry RPC after error@1837771354) -> (continuation of Deferred@1044947663 after retry RPC after error@247074864) -> (continuation of Deferred@1436041713 after retry RPC after error@1769761250) -> (continuation of Deferred@316268760 after retry RPC after error@1287412003) -> (continuation of Deferred@1539055244 after retry RPC after error@1359306592) -> (continuation of Deferred@210221752 after retry RPC after error@584884042) -> (continuation of Deferred@422559203 after retry RPC after error@1646927865) -> (continuation of Deferred@1405692798 after retry RPC after error@363448450) -> (continuation of Deferred@1896722289 after retry RPC after error@1131062142) -> (continuation of Deferred@1508045494 after retry RPC after error@39115984) -> (continuation of Deferred@507420108 after retry RPC after error@148483110) -> (continuation of Deferred@1180735689 after retry RPC after error@1660317321) -> (continuation of Deferred@139223014 after retry RPC after error@1295084117) -> (continuation of Deferred@257234410 after retry RPC after error@1585881263) -> (continuation of Deferred@887056374 after retry RPC after error@1920647418) -> (continuation of Deferred@1437032730 after retry RPC after error@1053761753) -> (continuation of Deferred@1910509601 after retry RPC after error@1438213111) -> (continuation of Deferred@1006135275 after retry RPC after error@2088124837) -> (continuation of Deferred@233191186 after retry RPC after error@324950914) -> (continuation of Deferred@1801564477 after retry RPC after error@634695325) -> (continuation of Deferred@422986642 after retry RPC after error@2027260285) -> (continuation of Deferred@509294339 after retry RPC after error@519819795)))
12:15:24.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:24.331710 20553 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 657dee8f9cfb4ce992876c093ff02768 consensus state has no leader
12:15:24.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:24.333871 20553 catalog_manager.cc:5957] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edaa4fbdcd2f4380a4915c1c0b0883f2 has no consensus state
12:15:24.355 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.363924 20782 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4fbdcd2f4380a4915c1c0b0883f2 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:24.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.368862 20952 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4fbdcd2f4380a4915c1c0b0883f2 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:24.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.370083 20952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4fbdcd2f4380a4915c1c0b0883f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.377578 20782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4fbdcd2f4380a4915c1c0b0883f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.384882 20554 catalog_manager.cc:5697] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac51161fda3d472ab4a07ec520f694dc (127.19.223.194). New cstate: current_term: 1 leader_uuid: "ac51161fda3d472ab4a07ec520f694dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } health_report { overall_health: UNKNOWN } } }
12:15:24.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.391789 21281 consensus_queue.cc:1048] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
12:15:24.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.395839 21094 tablet_service.cc:1511] Processing CreateTablet for tablet edaa4fbdcd2f4380a4915c1c0b0883f2 (DEFAULT_TABLE table=replication_test_table [id=cee5e91d959f4024be25f1424343d851]), partition=RANGE (key1) PARTITION 200 <= VALUES
12:15:24.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.397027 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edaa4fbdcd2f4380a4915c1c0b0883f2. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:24.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.423842 21276 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc: Bootstrap starting.
12:15:24.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.427825 21281 consensus_queue.cc:1048] T a812d211a3744a15bae682bb9b5592f5 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:24.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.428575 21277 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b: Bootstrap starting.
12:15:24.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.429981 21276 tablet_bootstrap.cc:654] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc: Neither blocks nor log segments found. Creating new log.
12:15:24.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.434918 21277 tablet_bootstrap.cc:654] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b: Neither blocks nor log segments found. Creating new log.
12:15:24.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.441210 21273 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a: Bootstrap starting.
12:15:24.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.447758 21276 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc: No bootstrap required, opened a new log
12:15:24.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.448166 21276 ts_tablet_manager.cc:1403] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
12:15:24.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.451189 21276 raft_consensus.cc:359] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.451928 21276 raft_consensus.cc:385] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.452198 21276 raft_consensus.cc:740] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Initialized, Role: FOLLOWER
12:15:24.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.452877 21276 consensus_queue.cc:260] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.460124 21276 ts_tablet_manager.cc:1434] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
12:15:24.466 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.479494 21277 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b: No bootstrap required, opened a new log
12:15:24.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.479921 21277 ts_tablet_manager.cc:1403] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.003s
12:15:24.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.491864 21277 raft_consensus.cc:359] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.496562 20553 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 093bf347b92e4ef5bf594787f4da6143: replication_test_table [id=cee5e91d959f4024be25f1424343d851] alter complete (version 0)
12:15:24.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.499962 21277 raft_consensus.cc:385] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.500283 21277 raft_consensus.cc:740] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a70185538824df48992807d60b77e4b, State: Initialized, Role: FOLLOWER
12:15:24.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.501935 21277 consensus_queue.cc:260] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.503995 21273 tablet_bootstrap.cc:654] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a: Neither blocks nor log segments found. Creating new log.
12:15:24.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.511109 21273 tablet_bootstrap.cc:492] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a: No bootstrap required, opened a new log
12:15:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.512068 21273 ts_tablet_manager.cc:1403] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
12:15:24.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.514372 21273 raft_consensus.cc:359] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.514923 21273 raft_consensus.cc:385] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:24.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.515143 21273 raft_consensus.cc:740] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8405c6dcf75f4c55821f8d76dd841e8a, State: Initialized, Role: FOLLOWER
12:15:24.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.515661 21285 raft_consensus.cc:493] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:24.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.515715 21273 consensus_queue.cc:260] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.516108 21285 raft_consensus.cc:515] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.518083 21285 leader_election.cc:290] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:24.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.519850 21273 ts_tablet_manager.cc:1434] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
12:15:24.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.520702 20802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" is_pre_election: true
12:15:24.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.521224 20802 raft_consensus.cc:2468] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:24.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.522647 20908 leader_election.cc:304] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:24.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.523653 21285 raft_consensus.cc:2804] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:24.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.523674 21284 raft_consensus.cc:493] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:24.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.524189 21285 raft_consensus.cc:493] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:24.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.524138 21284 raft_consensus.cc:515] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.524700 21285 raft_consensus.cc:3060] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 0 FOLLOWER]: Advancing to term 1
12:15:24.529 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.126:41267(127.19.5.126:41267)] disconnecting while in state READY
12:15:24.529 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.124:34641(127.19.5.124:34641)] disconnecting while in state READY
12:15:24.529 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.125:34511(127.19.5.125:34511)] disconnecting while in state READY
12:15:24.530 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.5.124:34641(127.19.5.124:34641)] handling channelInactive
12:15:24.530 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state READY due to: connection closed
12:15:24.530 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:24.530 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.5.126:41267(127.19.5.126:41267)] handling channelInactive
12:15:24.531 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state READY due to: connection closed
12:15:24.533 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-1
12:15:24.533 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:15:24.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.531718 21284 leader_election.cc:290] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), ac51161fda3d472ab4a07ec520f694dc (127.19.223.194:44817)
12:15:24.542 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:24.542 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:24.543 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:24.543 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.543 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.543 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.543 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.543 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.543 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.543 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.543 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.544 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.544 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:24.544 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.5.125:34511(127.19.5.125:34511)] handling channelInactive
12:15:24.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state READY due to: connection closed
12:15:24.544 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:24.544 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state READY
12:15:24.544 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state READY
12:15:24.545 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state READY
12:15:24.545 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:24.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:24.545 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:24.545 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:24.546 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:24.550 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-2
12:15:24.550 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
12:15:24.555 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:24.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:24.555 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
12:15:24.557 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:15:24.557 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:15:24.558 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:15:24.558 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:15:24.558 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:15:24.558 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:15:24.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.560120 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b" is_pre_election: true
12:15:24.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.560781 21114 raft_consensus.cc:2468] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 0.
12:15:24.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.568085 21285 raft_consensus.cc:515] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.572902 21114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a70185538824df48992807d60b77e4b"
12:15:24.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.573436 21114 raft_consensus.cc:3060] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 0 FOLLOWER]: Advancing to term 1
12:15:24.574 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:24.574 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:24.574 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:24.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.575 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.575 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.575 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.576 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:24.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.582181 21285 leader_election.cc:290] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Requested vote from peers 8405c6dcf75f4c55821f8d76dd841e8a (127.19.223.193:34773), 6a70185538824df48992807d60b77e4b (127.19.223.195:41151)
12:15:24.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.585238 20801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "ac51161fda3d472ab4a07ec520f694dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a"
12:15:24.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.585965 20801 raft_consensus.cc:3060] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 0 FOLLOWER]: Advancing to term 1
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:15:24.597 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:15:24.597 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:15:24.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.608222 21277 ts_tablet_manager.cc:1434] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.002s
12:15:24.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.610492 20801 raft_consensus.cc:2468] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:24.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.614722 20908 leader_election.cc:304] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc; no voters: 
12:15:24.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.615566 21308 raft_consensus.cc:2804] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 1 FOLLOWER]: Leader election won for term 1
12:15:24.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.616026 21308 raft_consensus.cc:697] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [term 1 LEADER]: Becoming Leader. State: Replica: ac51161fda3d472ab4a07ec520f694dc, State: Running, Role: LEADER
12:15:24.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.617358 20972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "6a70185538824df48992807d60b77e4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac51161fda3d472ab4a07ec520f694dc" is_pre_election: true
12:15:24.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.618219 21308 consensus_queue.cc:237] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } }
12:15:24.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.621003 21114 raft_consensus.cc:2468] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac51161fda3d472ab4a07ec520f694dc in term 1.
12:15:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.622548 20801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edaa4fbdcd2f4380a4915c1c0b0883f2" candidate_uuid: "6a70185538824df48992807d60b77e4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" is_pre_election: true
12:15:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.623327 20801 raft_consensus.cc:2393] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 8405c6dcf75f4c55821f8d76dd841e8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a70185538824df48992807d60b77e4b in current term 1: Already voted for candidate ac51161fda3d472ab4a07ec520f694dc in this term.
12:15:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.627556 21050 leader_election.cc:304] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a70185538824df48992807d60b77e4b; no voters: 8405c6dcf75f4c55821f8d76dd841e8a, ac51161fda3d472ab4a07ec520f694dc
12:15:24.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.628373 21284 raft_consensus.cc:2749] T edaa4fbdcd2f4380a4915c1c0b0883f2 P 6a70185538824df48992807d60b77e4b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:15:24.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.643975 20552 catalog_manager.cc:5697] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc reported cstate change: term changed from 0 to 1, leader changed from <none> to ac51161fda3d472ab4a07ec520f694dc (127.19.223.194). New cstate: current_term: 1 leader_uuid: "ac51161fda3d472ab4a07ec520f694dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac51161fda3d472ab4a07ec520f694dc" member_type: VOTER last_known_addr { host: "127.19.223.194" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 } health_report { overall_health: UNKNOWN } } }
12:15:24.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.704718 21308 consensus_queue.cc:1048] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:24.729 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:24.730 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.730 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.730 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:24.730 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:24.730 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:24.731 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.731 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.731 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:24.731 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.731 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.731 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:24.731 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:24.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:24.739877 21281 consensus_queue.cc:1048] T 657dee8f9cfb4ce992876c093ff02768 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:24.772 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:24.903 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:24.903 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:24.903 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:24.904 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.904 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.904 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:24.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:24.905 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.905 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.905 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:24.905 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:24.953 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:15:24.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.031 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:25.031 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:25.031 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:25.031 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.032 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.032 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.032 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.032 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.032 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.032 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:25.065 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:15:25.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:25.064002 21281 consensus_queue.cc:1048] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8405c6dcf75f4c55821f8d76dd841e8a" member_type: VOTER last_known_addr { host: "127.19.223.193" port: 34773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:25.065 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:15:25.065 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:15:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:25.089093 21300 consensus_queue.cc:1048] T edaa4fbdcd2f4380a4915c1c0b0883f2 P ac51161fda3d472ab4a07ec520f694dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a70185538824df48992807d60b77e4b" member_type: VOTER last_known_addr { host: "127.19.223.195" port: 41151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:25.130 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:15:25.189 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.222 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:25.223 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:25.223 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:25.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.223 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.223 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.223 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.224 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.225 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.225 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.225 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:25.271 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.430 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:25.430 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:25.431 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:25.431 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.431 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.431 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:25.432 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.432 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.432 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:25.432 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.432 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.432 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:25.432 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:25.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.682 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:25.683 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:25.683 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:25.683 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.683 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.683 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:25.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.683 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:25.683 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.684 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.684 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:25.684 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:25.689 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:25.930 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:15:25.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.026 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:26.026 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:26.026 [DEBUG - pool-254-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:26.026 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.027 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.027 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.027 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.027 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.027 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.027 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.027 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.027 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:26.028 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27880), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [233ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [236ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [237ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [246ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [249ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [303ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [603ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1243ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1463ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4500ms] refreshing cache from master, [4500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4501ms] too many traces: truncated at 100 traces, deferred=Deferred@109689212(state=PENDING, result=null, callback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296), errback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296)))
12:15:26.029 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:15:26.029 [WARN - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27880), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [233ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [236ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [237ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [246ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [249ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [303ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [603ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1243ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1463ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4500ms] refreshing cache from master, [4500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4501ms] too many traces: truncated at 100 traces, deferred=Deferred@109689212(state=PENDING, result=null, callback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296), errback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.029 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
12:15:26.031 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
12:15:26.033 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27880), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [233ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [234ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [236ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [237ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [246ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [246ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [248ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [249ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [249ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [303ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [303ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [602ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [603ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [603ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1243ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1243ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1463ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4500ms] refreshing cache from master, [4500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4501ms] too many traces: truncated at 100 traces, deferred=Deferred@109689212(state=PENDING, result=null, callback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296), errback=(continuation of Deferred@768551423 after retry RPC after error@1182237807) -> (continuation of Deferred@1679823081 after retry RPC after error@791217992) -> (continuation of Deferred@2080199555 after retry RPC after error@22279279) -> (continuation of Deferred@1703943156 after retry RPC after error@48517961) -> (continuation of Deferred@320104925 after retry RPC after error@234493788) -> (continuation of Deferred@1758519980 after retry RPC after error@1208912612) -> (continuation of Deferred@2028226745 after retry RPC after error@628748302) -> (continuation of Deferred@1246995343 after retry RPC after error@1991661963) -> (continuation of Deferred@743269988 after retry RPC after error@1188956771) -> (continuation of Deferred@289834732 after retry RPC after error@1433993038) -> (continuation of Deferred@314691011 after retry RPC after error@611991786) -> (continuation of Deferred@19841903 after retry RPC after error@322887307) -> (continuation of Deferred@252552954 after retry RPC after error@2030492385) -> (continuation of Deferred@247745301 after retry RPC after error@1810564800) -> (continuation of Deferred@154359601 after retry RPC after error@1177376036) -> (continuation of Deferred@1788686871 after retry RPC after error@1509160066) -> (continuation of Deferred@1256893010 after retry RPC after error@1724007006) -> (continuation of Deferred@1707919643 after retry RPC after error@593327812) -> (continuation of Deferred@1014685895 after retry RPC after error@1222542756) -> (continuation of Deferred@1264130485 after retry RPC after error@66760012) -> (continuation of Deferred@1751976236 after retry RPC after error@1411531296)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:26.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:26.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:26.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.034 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.034 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
12:15:26.034 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
12:15:26.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.034 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:15:26.034 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:26.035 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.035 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.035 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.034 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.035 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:26.035 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:26.036 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:26.036 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:26.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:26.036 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.036 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.036 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:26.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:26.037 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:26.089 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:15:26.090 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:26.091 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:26.091 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:26.091 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.091 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.091 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.091 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.091 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.091 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.091 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:26.102 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:15:26.119 [INFO - flink-metrics-6] (Slf4jLogger.scala:117) Slf4jLogger started
12:15:26.138 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:15:26.155 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:15:26.160 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:15:26.161 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:15:26.161 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:15:26.161 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:15:26.162 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:15:26.162 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:15:26.162 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:15:26.162 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:15:26.163 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:15:26.163 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:15:26.163 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:15:26.163 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:15:26.163 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:15:26.163 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:15:26.164 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:15:26.164 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:15:26.165 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:15:26.165 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:15:26.165 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:15:26.165 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_4d44fb392aeb31394a4775acdb01f36f/blobStorage
12:15:26.165 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:36675 - max concurrent requests: 50 - max backlog: 1000
12:15:26.166 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_4d44fb392aeb31394a4775acdb01f36f/blobStorage
12:15:26.167 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_4d44fb392aeb31394a4775acdb01f36f/blobStorage
12:15:26.167 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:15:26.167 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 9e1cd367-d5f4-490c-9d4d-a76e7e36981a
12:15:26.170 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:15:26.170 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-5cc5e028-c7d2-41ec-a3d8-29431ecffa55
12:15:26.174 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-1609586d-0c13-44b2-8668-ac3ff0c1527d
12:15:26.210 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:26.210 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:26.210 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:26.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.210 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.210 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:26.211 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.211 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.211 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:26.211 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:26.211 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:26.234 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:15:26.235 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:15:26.235 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:15:26.235 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:15:26.236 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:15:26.237 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_16 .
12:15:26.243 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
12:15:26.243 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-51d3af60-69b5-4300-a24f-9ab7e49e4512
12:15:26.244 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:15:26.244 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:15:26.257 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:26.258 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:26.258 [DEBUG - pool-252-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:26.258 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.258 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.258 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.258 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.258 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.258 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.259 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:26.259 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:15:26.259 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:15:26.259 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [38ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [118ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [125ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [126ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [227ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [263ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [522ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [983ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [984ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1221ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1524ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5022ms] refreshing cache from master, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1930175219(state=PENDING, result=null, callback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824), errback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824)))
12:15:26.260 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:26.260 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [38ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [118ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [125ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [126ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [227ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [263ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [522ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [983ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [984ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1221ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1524ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5022ms] refreshing cache from master, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1930175219(state=PENDING, result=null, callback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824), errback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.260 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
12:15:26.262 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:15:26.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.292 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:38415
12:15:26.292 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:15:26.292 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28125), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [34ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [38ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [42ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [42ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [118ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [125ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [126ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [227ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [239ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [263ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [281ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [342ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [343ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [522ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [522ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [983ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [984ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [984ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1221ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1524ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5022ms] refreshing cache from master, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5022ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1930175219(state=PENDING, result=null, callback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824), errback=(continuation of Deferred@949713105 after retry RPC after error@795655288) -> (continuation of Deferred@1023296341 after retry RPC after error@779609475) -> (continuation of Deferred@1296653676 after retry RPC after error@118273985) -> (continuation of Deferred@1227274398 after retry RPC after error@1483474884) -> (continuation of Deferred@1598653336 after retry RPC after error@1033471247) -> (continuation of Deferred@1099376746 after retry RPC after error@2037204409) -> (continuation of Deferred@1781226575 after retry RPC after error@460004856) -> (continuation of Deferred@1666691719 after retry RPC after error@1879339993) -> (continuation of Deferred@1090359474 after retry RPC after error@62570888) -> (continuation of Deferred@1571264754 after retry RPC after error@242135588) -> (continuation of Deferred@582667099 after retry RPC after error@2002380805) -> (continuation of Deferred@374906388 after retry RPC after error@1843192169) -> (continuation of Deferred@424152986 after retry RPC after error@560579958) -> (continuation of Deferred@1939031921 after retry RPC after error@2035165123) -> (continuation of Deferred@547607471 after retry RPC after error@1326375096) -> (continuation of Deferred@651140839 after retry RPC after error@775407042) -> (continuation of Deferred@272061696 after retry RPC after error@679771294) -> (continuation of Deferred@1919350735 after retry RPC after error@1659843988) -> (continuation of Deferred@1222304668 after retry RPC after error@1127286421) -> (continuation of Deferred@111954355 after retry RPC after error@494178151) -> (continuation of Deferred@36522326 after retry RPC after error@1231286824)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.293 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:26.293 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
12:15:26.294 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:15:26.313 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:38415 was granted leadership with leaderSessionID=d3a33e8f-4953-4ade-b57b-f38733f5a628
12:15:26.313 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:38415 , session=d3a33e8f-4953-4ade-b57b-f38733f5a628
12:15:26.325 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:15:26.326 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:15:26.326 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:15:26.326 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 7db94757-3b39-4679-88ab-381fde8ef92d. Creating new DispatcherLeaderProcess.
12:15:26.326 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:15:26.328 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:15:26.330 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:15:26.330 [INFO - mini-cluster-io-thread-4] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:15:26.332 [INFO - mini-cluster-io-thread-4] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_17 .
12:15:26.333 [INFO - pool-291-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id ffac1cbd-5bac-4bd9-b0fc-6bd3ac730583.
12:15:26.335 [INFO - pool-291-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_18 .
12:15:26.339 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_17 , session=7db94757-3b39-4679-88ab-381fde8ef92d
12:15:26.344 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
12:15:26.348 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:15:26.349 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:15:26.349 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:15:26.349 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:15:26.358 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.361 [INFO - mini-cluster-io-thread-3] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_18 , session=ffac1cbd-5bac-4bd9-b0fc-6bd3ac730583
12:15:26.361 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(b0fc6bd3ac730583ffac1cbd5bac4bd9).
12:15:26.385 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:26.385 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:26.385 [DEBUG - pool-256-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:26.385 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.386 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.386 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.386 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.386 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.386 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.387 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.387 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.387 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.387 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:26.388 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28212), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [71ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [72ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [158ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [166ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [172ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [172ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [220ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [302ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [643ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1140ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5383ms] refreshing cache from master, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5386ms] too many traces: truncated at 100 traces, deferred=Deferred@1609637639(state=PENDING, result=null, callback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998), errback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998)))
12:15:26.388 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:15:26.388 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:26.389 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28212), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [71ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [72ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [158ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [166ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [172ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [172ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [220ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [302ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [643ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1140ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5383ms] refreshing cache from master, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5386ms] too many traces: truncated at 100 traces, deferred=Deferred@1609637639(state=PENDING, result=null, callback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998), errback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.393 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
12:15:26.394 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:15:26.396 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28212), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [55ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [71ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [72ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [158ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [166ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [172ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [172ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [219ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [220ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [223ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [223ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [262ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [282ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [301ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [302ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [302ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [642ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [643ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1140ms] refreshing cache from master, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1760ms] refreshing cache from master, [1760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1763ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3100ms] refreshing cache from master, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5383ms] refreshing cache from master, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5386ms] too many traces: truncated at 100 traces, deferred=Deferred@1609637639(state=PENDING, result=null, callback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998), errback=(continuation of Deferred@178660950 after retry RPC after error@220697097) -> (continuation of Deferred@1865112781 after retry RPC after error@947220232) -> (continuation of Deferred@56261318 after retry RPC after error@853284734) -> (continuation of Deferred@128248028 after retry RPC after error@347789839) -> (continuation of Deferred@1155927572 after retry RPC after error@374572561) -> (continuation of Deferred@907116047 after retry RPC after error@1949937760) -> (continuation of Deferred@14386781 after retry RPC after error@179497817) -> (continuation of Deferred@938347782 after retry RPC after error@250417451) -> (continuation of Deferred@1389926341 after retry RPC after error@1336755940) -> (continuation of Deferred@149746730 after retry RPC after error@1861142613) -> (continuation of Deferred@2023623922 after retry RPC after error@1562505059) -> (continuation of Deferred@847453513 after retry RPC after error@716691244) -> (continuation of Deferred@575055636 after retry RPC after error@1892556488) -> (continuation of Deferred@1519201485 after retry RPC after error@1318559239) -> (continuation of Deferred@1501490886 after retry RPC after error@1497797503) -> (continuation of Deferred@1788749790 after retry RPC after error@403438380) -> (continuation of Deferred@908930613 after retry RPC after error@1528667876) -> (continuation of Deferred@1084682894 after retry RPC after error@120824621) -> (continuation of Deferred@1479567736 after retry RPC after error@1877812772) -> (continuation of Deferred@405310421 after retry RPC after error@35154230) -> (continuation of Deferred@1496890276 after retry RPC after error@1600285345) -> (continuation of Deferred@55059643 after retry RPC after error@1121500221) -> (continuation of Deferred@1587661401 after retry RPC after error@307921998)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.397 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:26.399 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
12:15:26.399 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:15:26.437 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.437 [INFO - flink-pekko.actor.default-dispatcher-8] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.437 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:1080) Registering TaskManager with ResourceID 9e1cd367-d5f4-490c-9d4d-a76e7e36981a (pekko://flink/user/rpc/taskmanager_16) at ResourceManager
12:15:26.440 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_18 under registration id 8d630f19fd96b3227d69e527c7aafe82.
12:15:26.440 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:344) Registering task executor 9e1cd367-d5f4-490c-9d4d-a76e7e36981a under 8d630f19fd96b3227d69e527c7aafe82 at the slot manager.
12:15:26.442 [INFO - flink-pekko.actor.default-dispatcher-8] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-5273b45840e0da6e6ca30141a2a11dd8'.
12:15:26.443 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 5273b45840e0da6e6ca30141a2a11dd8 was granted leadership with leader id dd717d40-ed14-4ec7-90a1-8a4ef27ecab9. Creating new JobMasterServiceProcess.
12:15:26.452 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_19 .
12:15:26.457 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.458 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.459 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 555b759a33406205c8ea45986840a605 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.459 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.459 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:15:26.460 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:15:26.460 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@446c4015
12:15:26.460 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:26.460 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:15:26.461 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:26.461 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:26.461 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:26.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.461 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.462 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:26.464 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:15:26.464 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@7da11941 for Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8).
12:15:26.465 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_19 , session=dd717d40-ed14-4ec7-90a1-8a4ef27ecab9
12:15:26.465 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.465 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (5273b45840e0da6e6ca30141a2a11dd8) under job master id 90a18a4ef27ecab9dd717d40ed144ec7.
12:15:26.466 [INFO - flink-pekko.actor.default-dispatcher-7] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:26.467 [DEBUG - flink-pekko.actor.default-dispatcher-7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.468 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:15:26.468 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state CREATED to RUNNING.
12:15:26.469 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:15:26.469 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:15:26.470 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:26.470 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:15:26.470 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:15:26.470 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:26.471 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_18(b0fc6bd3ac730583ffac1cbd5bac4bd9)
12:15:26.471 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.5.125:34511(127.19.5.125:34511)] Successfully connected to peer
12:15:26.471 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:26.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:26.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:26.471 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.5.124:34641(127.19.5.124:34641)] Successfully connected to peer
12:15:26.473 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.473 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.473 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.473 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.473 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.473 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:15:26.474 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:26.474 [INFO - flink-pekko.actor.default-dispatcher-9] (ResourceManager.java:390) Registering job manager 90a18a4ef27ecab9dd717d40ed144ec7@pekko://flink/user/rpc/jobmanager_19 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.474 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.474 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.474 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:26.481 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.5.126:41267(127.19.5.126:41267)] Successfully connected to peer
12:15:26.486 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.124
12:15:26.487 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager 90a18a4ef27ecab9dd717d40ed144ec7@pekko://flink/user/rpc/jobmanager_19 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.491 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:26.491 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:26.492 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:26.492 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.492 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:26.492 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.492 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.492 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:26.492 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.492 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.492 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:26.492 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:26.492 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.493 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.493 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.493 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.493 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.493 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.494 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.494 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.494 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.494 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.494 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.494 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.494 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.495 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28344), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [148ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [237ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [238ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [239ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [239ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [263ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [263ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [343ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [743ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1521ms] refreshing cache from master, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1524ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1825ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5202ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@154638040(state=PENDING, result=null, callback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315), errback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315)))
12:15:26.497 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.125
12:15:26.498 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.499 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.499 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.500 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28344), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [148ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [237ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [238ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [239ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [239ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [263ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [263ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [343ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [743ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1521ms] refreshing cache from master, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1524ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1825ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5202ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@154638040(state=PENDING, result=null, callback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315), errback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28344), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [148ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [237ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [238ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [239ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [239ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [263ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [263ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [343ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [743ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1521ms] refreshing cache from master, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1524ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1825ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5202ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@154638040(state=PENDING, result=null, callback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315), errback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.502 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.502 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.502 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.502 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.502 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.502 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.503 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.503 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.503 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.503 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:26.503 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:26.503 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:26.504 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.504 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:26.504 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:26.504 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:26.504 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:26.504 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:26.504 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:26.511 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:26.511 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:26.511 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:26.511 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:26.512 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xfe9ec5cb, L:/127.0.0.1:34136 - R:/127.19.5.124:34641] using SASL/PLAIN
12:15:26.512 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.512 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.513 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.514 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.514 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.514 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.514 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.515 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.520 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.126
12:15:26.521 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: b0fc6bd3ac730583ffac1cbd5bac4bd9.
12:15:26.522 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:26.528 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28344), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [148ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [237ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [238ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [239ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [239ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [263ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [263ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [343ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [743ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1521ms] refreshing cache from master, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1524ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1825ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5202ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@154638040(state=PENDING, result=null, callback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315), errback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28344), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [41ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [42ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [43ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [43ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [148ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [161ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [237ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [238ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [239ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [239ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [262ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [263ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [263ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [281ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [342ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [343ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [343ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [422ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [422ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [603ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [603ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [742ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [743ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [743ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1521ms] refreshing cache from master, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1524ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1821ms] refreshing cache from master, [1821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1824ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1825ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1825ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [5202ms] refreshing cache from master, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [5202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [5203ms] too many traces: truncated at 100 traces, deferred=Deferred@154638040(state=PENDING, result=null, callback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315), errback=(continuation of Deferred@563228122 after retry RPC after error@1885643206) -> (continuation of Deferred@1952620167 after retry RPC after error@1096173445) -> (continuation of Deferred@1905942152 after retry RPC after error@614841324) -> (continuation of Deferred@1146330969 after retry RPC after error@927629881) -> (continuation of Deferred@336061510 after retry RPC after error@502552561) -> (continuation of Deferred@1157999169 after retry RPC after error@649966482) -> (continuation of Deferred@221468375 after retry RPC after error@851952479) -> (continuation of Deferred@1526210788 after retry RPC after error@294795530) -> (continuation of Deferred@109068289 after retry RPC after error@181511861) -> (continuation of Deferred@288704523 after retry RPC after error@292514126) -> (continuation of Deferred@367768362 after retry RPC after error@302533420) -> (continuation of Deferred@692468854 after retry RPC after error@1133057289) -> (continuation of Deferred@187927729 after retry RPC after error@1538451408) -> (continuation of Deferred@1133495644 after retry RPC after error@1218814329) -> (continuation of Deferred@1608837848 after retry RPC after error@329521811) -> (continuation of Deferred@784111774 after retry RPC after error@1274497625) -> (continuation of Deferred@868080597 after retry RPC after error@16662451) -> (continuation of Deferred@1254899546 after retry RPC after error@999817688) -> (continuation of Deferred@1722160653 after retry RPC after error@399818445) -> (continuation of Deferred@1011443074 after retry RPC after error@1193551122) -> (continuation of Deferred@291784069 after retry RPC after error@603239346) -> (continuation of Deferred@1416017723 after retry RPC after error@839648272) -> (continuation of Deferred@24586169 after retry RPC after error@119041286) -> (continuation of Deferred@1722211761 after retry RPC after error@886602225) -> (continuation of Deferred@204134972 after retry RPC after error@1218373346) -> (continuation of Deferred@411431189 after retry RPC after error@1868895237) -> (continuation of Deferred@893700335 after retry RPC after error@173183315)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:26.529 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:26.529 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=59), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [59ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: OK, deferred=null) after lookup
12:15:26.529 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:26.529 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
12:15:26.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.532 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
12:15:26.532 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:26.532 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.533 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.533 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.533 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:15:26.533 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.533 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.533 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
12:15:26.533 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:15:26.533 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.533 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.533 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.533 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x99b27706, L:/127.0.0.1:32898 - R:/127.19.5.125:34511] using SASL/PLAIN
12:15:26.533 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.534 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.534 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.534 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.536 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.539 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:26.539 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:26.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
12:15:26.540 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:15:26.540 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 07e34f4f54584c2e8db79b3792981f0c for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:26.541 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b056aa396cbb436e990ec90ba0e51d5b for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:26.541 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b734e6fab27c4d5bb040bf1c1b00ac30 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:26.541 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:26.543 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6bd3406d, L:/127.0.0.1:41158 - R:/127.19.5.126:41267] using SASL/PLAIN
12:15:26.549 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:26.549 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
12:15:26.550 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:26.550 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
12:15:26.551 [DEBUG - main] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:26.551 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:15:26.551 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:26.552 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.552 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.552 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.553 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.553 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.553 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.553 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.554 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.554 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.554 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.554 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.562 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:26.566 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:26.572 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.572 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.572 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.573 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.573 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.573 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.573 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.573 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.573 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.573 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.578 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:26.579 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.582 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x7204c8aa, L:/127.0.0.1:46038 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:26.587 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:26.590 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 5273b45840e0da6e6ca30141a2a11dd8
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 9e1cd367-d5f4-490c-9d4d-a76e7e36981a
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:15:26.590 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot d35a590e069d52f250d74ff29b6a113a from 9e1cd367-d5f4-490c-9d4d-a76e7e36981a for job 5273b45840e0da6e6ca30141a2a11dd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.591 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 11655f63c26cfc770969daf002dc4f10 from 9e1cd367-d5f4-490c-9d4d-a76e7e36981a for job 5273b45840e0da6e6ca30141a2a11dd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.591 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.591 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request d35a590e069d52f250d74ff29b6a113a for job 5273b45840e0da6e6ca30141a2a11dd8 from resource manager with leader id b0fc6bd3ac730583ffac1cbd5bac4bd9.
12:15:26.591 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for d35a590e069d52f250d74ff29b6a113a with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.591 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot da2c643a0e0cd56e531ac7783f030706 from 9e1cd367-d5f4-490c-9d4d-a76e7e36981a for job 5273b45840e0da6e6ca30141a2a11dd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.592 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot b54796e71d0c583e2956576d9a50fdec from 9e1cd367-d5f4-490c-9d4d-a76e7e36981a for job 5273b45840e0da6e6ca30141a2a11dd8 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.592 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job 5273b45840e0da6e6ca30141a2a11dd8 for job leader monitoring.
12:15:26.592 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 11655f63c26cfc770969daf002dc4f10 for job 5273b45840e0da6e6ca30141a2a11dd8 from resource manager with leader id b0fc6bd3ac730583ffac1cbd5bac4bd9.
12:15:26.593 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 11655f63c26cfc770969daf002dc4f10 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.592 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_19 with leader id dd717d40-ed14-4ec7-90a1-8a4ef27ecab9.
12:15:26.593 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.593 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.593 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.594 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request da2c643a0e0cd56e531ac7783f030706 for job 5273b45840e0da6e6ca30141a2a11dd8 from resource manager with leader id b0fc6bd3ac730583ffac1cbd5bac4bd9.
12:15:26.594 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for da2c643a0e0cd56e531ac7783f030706 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.594 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request b54796e71d0c583e2956576d9a50fdec for job 5273b45840e0da6e6ca30141a2a11dd8 from resource manager with leader id b0fc6bd3ac730583ffac1cbd5bac4bd9.
12:15:26.595 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for b54796e71d0c583e2956576d9a50fdec with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:15:26.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.596 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:15:26.594 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.594 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x99c7a5f6, L:/127.0.0.1:41630 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:26.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.598 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.598 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.600 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_19 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.600 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1783) Establish JobManager connection for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.600 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.601 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:26.601 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x09cce9dd, L:/127.0.0.1:40948 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:26.601 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=82), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [48ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:26.602 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:15:26.602 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id 11655f63c26cfc770969daf002dc4f10
12:15:26.603 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 11655f63c26cfc770969daf002dc4f10.
12:15:26.604 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:26.604 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:15:26.604 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.605 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 5273b45840e0da6e6ca30141a2a11dd8
12:15:26.608 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 11655f63c26cfc770969daf002dc4f10.
12:15:26.613 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.613 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.613 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.613 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.613 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.613 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.613 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.613 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.614 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.617 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:26.617 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:26.617 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:26.617 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:15:26.617 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:15:26.617 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:26.617 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=9), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.19.223.252:41911, [9ms] Sub RPC GetTableLocations: received response from server master-127.19.223.252:41911: OK, deferred=null)) after lookup
12:15:26.618 [DEBUG - kudu-nio-0] (Connection.java:748) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] connecting to peer
12:15:26.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@456df5d9
12:15:26.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:26.618 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:15:26.619 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:15:26.620 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:15:26.620 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id da2c643a0e0cd56e531ac7783f030706
12:15:26.621 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] Successfully connected to peer
12:15:26.622 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:15:26.622 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id b54796e71d0c583e2956576d9a50fdec
12:15:26.623 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:15:26.623 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id d35a590e069d52f250d74ff29b6a113a
12:15:26.623 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:15:26.623 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot da2c643a0e0cd56e531ac7783f030706.
12:15:26.631 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id da2c643a0e0cd56e531ac7783f030706.
12:15:26.636 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@429ee75d
12:15:26.638 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.641 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot b54796e71d0c583e2956576d9a50fdec.
12:15:26.642 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id b54796e71d0c583e2956576d9a50fdec.
12:15:26.642 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:15:26.642 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:15:26.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@47933f50
12:15:26.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:26.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:15:26.643 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:15:26.644 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:15:26.646 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@69ef5970
12:15:26.646 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:26.646 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 11655f63c26cfc770969daf002dc4f10.
12:15:26.646 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:15:26.646 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot da2c643a0e0cd56e531ac7783f030706.
12:15:26.647 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot b54796e71d0c583e2956576d9a50fdec.
12:15:26.647 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d35a590e069d52f250d74ff29b6a113a.
12:15:26.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:15:26.647 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d35a590e069d52f250d74ff29b6a113a.
12:15:26.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35e770ab
12:15:26.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:26.647 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:15:26.648 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:15:26.648 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:15:26.648 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id d35a590e069d52f250d74ff29b6a113a.
12:15:26.648 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.651 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.652 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.653 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.653 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.654 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.654 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.654 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.654 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.655 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x051513f1, L:/127.0.0.1:58760 - R:/127.19.223.194:44817] using TOKEN/null
12:15:26.660 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a53365e
12:15:26.662 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.663 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:26.665 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.665 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:26.665 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:26.667 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:26.667 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:26.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:26.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:26.668 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.668 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.668 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:26.669 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.669 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.669 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:26.669 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.669 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.669 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:26.669 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:26.673 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.673 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:26.674 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.677 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:26.679 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.685 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:26.686 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:26.686 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:15:26.686 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:15:26.687 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@688e1f9a
12:15:26.687 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:26.687 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:15:26.688 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:15:26.688 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:15:26.692 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6cc003b5
12:15:26.694 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:26.694 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.696 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:26.706 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.709 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbc37afba, L:/127.0.0.1:46044 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:26.711 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.721 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:26.723 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8e79110c, L:/127.0.0.1:41640 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:26.726 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:26.736 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.736 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:26.740 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.741 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:26.746 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.752 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:26.752 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=113), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [66ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:26.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.765 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.765 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@28253923
12:15:26.767 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:15:26.767 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:15:26.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.773 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:26.773 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:26.773 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:26.774 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.774 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.774 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:26.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:26.774 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.774 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.775 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:26.775 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:26.784 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.789 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:26.792 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:26.793 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9bae79ac, L:/127.0.0.1:40964 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:26.796 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:26.799 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:26.801 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:26.801 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:26.802 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:26.805 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:26.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.805 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:26.812 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.812 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:26.813 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:26.814 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:26.814 [DEBUG - pool-250-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:26.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:26.814 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:26.815 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.815 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.815 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:26.815 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.815 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.815 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:26.815 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:26.816 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28690), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [25ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [50ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [51ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [51ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [139ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [151ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [159ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [159ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [230ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [230ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [234ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [263ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [282ms] refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [283ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [283ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [364ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [463ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [464ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [683ms] refreshing cache from master, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [684ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [685ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [685ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [685ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1001ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1003ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1003ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1408ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1408ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2320ms] refreshing cache from master, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2322ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2323ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2323ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3020ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3022ms] too many traces: truncated at 100 traces, deferred=Deferred@1708506223(state=PENDING, result=null, callback=(continuation of Deferred@142461534 after retry RPC after error@1854095900) -> (continuation of Deferred@1124876152 after retry RPC after error@192075186) -> (continuation of Deferred@1832636856 after retry RPC after error@433913249) -> (continuation of Deferred@998893085 after retry RPC after error@642481051) -> (continuation of Deferred@365877499 after retry RPC after error@1803623958) -> (continuation of Deferred@525116533 after retry RPC after error@1655083940) -> (continuation of Deferred@30184971 after retry RPC after error@1658734986) -> (continuation of Deferred@415966888 after retry RPC after error@1319546278) -> (continuation of Deferred@733943479 after retry RPC after error@1002281043) -> (continuation of Deferred@2046957546 after retry RPC after error@28466833) -> (continuation of Deferred@1382804158 after retry RPC after error@88317856) -> (continuation of Deferred@1863607717 after retry RPC after error@2084694016) -> (continuation of Deferred@1903350572 after retry RPC after error@1758850109) -> (continuation of Deferred@614499791 after retry RPC after error@1465022643) -> (continuation of Deferred@819866310 after retry RPC after error@1999477988) -> (continuation of Deferred@1459872051 after retry RPC after error@324045952) -> (continuation of Deferred@1377377334 after retry RPC after error@1237872685) -> (continuation of Deferred@17439326 after retry RPC after error@380215923) -> (continuation of Deferred@206300220 after retry RPC after error@109618304) -> (continuation of Deferred@1459721957 after retry RPC after error@207625292) -> (continuation of Deferred@1608082424 after retry RPC after error@473325607) -> (continuation of Deferred@1205562362 after retry RPC after error@1272290609) -> (continuation of Deferred@1602740496 after retry RPC after error@1881114015), errback=(continuation of Deferred@142461534 after retry RPC after error@1854095900) -> (continuation of Deferred@1124876152 after retry RPC after error@192075186) -> (continuation of Deferred@1832636856 after retry RPC after error@433913249) -> (continuation of Deferred@998893085 after retry RPC after error@642481051) -> (continuation of Deferred@365877499 after retry RPC after error@1803623958) -> (continuation of Deferred@525116533 after retry RPC after error@1655083940) -> (continuation of Deferred@30184971 after retry RPC after error@1658734986) -> (continuation of Deferred@415966888 after retry RPC after error@1319546278) -> (continuation of Deferred@733943479 after retry RPC after error@1002281043) -> (continuation of Deferred@2046957546 after retry RPC after error@28466833) -> (continuation of Deferred@1382804158 after retry RPC after error@88317856) -> (continuation of Deferred@1863607717 after retry RPC after error@2084694016) -> (continuation of Deferred@1903350572 after retry RPC after error@1758850109) -> (continuation of Deferred@614499791 after retry RPC after error@1465022643) -> (continuation of Deferred@819866310 after retry RPC after error@1999477988) -> (continuation of Deferred@1459872051 after retry RPC after error@324045952) -> (continuation of Deferred@1377377334 after retry RPC after error@1237872685) -> (continuation of Deferred@17439326 after retry RPC after error@380215923) -> (continuation of Deferred@206300220 after retry RPC after error@109618304) -> (continuation of Deferred@1459721957 after retry RPC after error@207625292) -> (continuation of Deferred@1608082424 after retry RPC after error@473325607) -> (continuation of Deferred@1205562362 after retry RPC after error@1272290609) -> (continuation of Deferred@1602740496 after retry RPC after error@1881114015)))
12:15:26.816 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:26.818 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.826 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:26.828 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:26.830 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.833 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:26.833 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.837 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:26.853 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x49053c64, L:/127.0.0.1:41650 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:26.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.854 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.860 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfd3021c5, L:/127.0.0.1:41666 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:26.865 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:26.868 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=219), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [177ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:26.874 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.874 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:26.876 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.879 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.879 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:26.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.883 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5588c82
12:15:26.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:15:26.884 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:15:26.886 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.890 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:26.890 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=227), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [203ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:26.893 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.897 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:26.897 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20b610a
12:15:26.898 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:15:26.899 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x54ac65f9, L:/127.0.0.1:46056 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:26.902 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:26.905 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:15:26.908 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:26.908 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.912 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9a7e0309, L:/127.0.0.1:40978 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:26.913 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.916 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb3400cef, L:/127.0.0.1:46072 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:26.917 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:26.919 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8fff0467, L:/127.0.0.1:40980 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:26.925 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:15:26.934 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:15:26.935 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8a92cf60c600602b5f39cf606254ec977e24b0c05e5ca58f0817b56ee8d30677'}]
12:15:26.938 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.941 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.942 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:26.944 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:15:26.945 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='95322cf5e64234da7cc09b225ba44e86410b87813323c6ef4642f5a3b3ded796'}]
12:15:26.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.946 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:26.946 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:26.952 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:26.955 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:15:26.957 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299998, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:26.963 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:26.973 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:15:26.977 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:15:26.988 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:15:26.992 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.19.223.252:41911(127.19.223.252:41911)] Successfully connected to peer
12:15:26.995 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.252
12:15:27.000 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:15:27.005 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.19.223.253:37033(127.19.223.253:37033)] Successfully connected to peer
12:15:27.009 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.009 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.013 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:27.013 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:27.013 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:27.014 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.014 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.014 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.014 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.014 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:27.014 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.253
12:15:27.018 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.023 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.19.223.254:42193(127.19.223.254:42193)] Successfully connected to peer
12:15:27.028 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.223.254
12:15:27.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:27.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:27.034 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:27.035 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.035 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.035 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.035 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.035 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.035 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.036 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.036 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.036 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.036 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:27.038 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:27.049 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.055 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:15:27.062 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299998, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:27.064 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4295e9e5, L:/127.0.0.1:41682 - R:/127.19.223.252:41911] using SASL/PLAIN
12:15:27.070 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.073 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:15:27.073 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=377), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [148ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: OK, deferred=null) after lookup
12:15:27.075 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.075 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.079 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.080 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.080 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:27.081 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:27.081 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:27.081 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.081 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.081 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.082 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.082 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.082 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.082 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.082 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.082 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.082 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:27.085 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.089 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcd4482d8, L:/127.0.0.1:46076 - R:/127.19.223.253:37033] using SASL/PLAIN
12:15:27.092 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:27.096 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:27.096 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@11837dca
12:15:27.097 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:15:27.098 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:15:27.099 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.105 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc43af7f3, L:/127.0.0.1:40994 - R:/127.19.223.254:42193] using SASL/PLAIN
12:15:27.110 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:15:27.110 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='2d72bbcc6ff3b1760b5044548fa76f808bb1e813b8897613a31beb12cb1f7b8b'}]
12:15:27.112 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:27.124 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:15:27.129 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:27.139 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:15:27.140 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:15:27.141 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:15:27.141 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.141 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.142 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299998, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:27.144 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:27.145 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:27.146 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.146 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.146 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:27.148 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:27.152 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:27.152 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512927162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:27.164 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.170 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x10a6c888, L:/127.0.0.1:43538 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:27.172 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:27.181 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.184 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd73b6f5f, L:/127.0.0.1:43560 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:27.197 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268946817024001) for scanner KuduScanner(table=replication_test_table, tablet=b734e6fab27c4d5bb040bf1c1b00ac30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.198 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [2d72bbcc6ff3b1760b5044548fa76f808bb1e813b8897613a31beb12cb1f7b8b]
12:15:27.198 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [2d72bbcc6ff3b1760b5044548fa76f808bb1e813b8897613a31beb12cb1f7b8b]
12:15:27.198 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 5273b45840e0da6e6ca30141a2a11dd8 (2850 bytes, checkpointDuration=36 ms, finalizationTime=0 ms).
12:15:27.199 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:15:27.199 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:15:27.199 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:27.199 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 2d72bbcc6ff3b1760b5044548fa76f808bb1e813b8897613a31beb12cb1f7b8b finished by subtask 2; deferring removal (restored in pending)
12:15:27.200 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:15:27.200 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:27.200 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 2d72bbcc6ff3b1760b5044548fa76f808bb1e813b8897613a31beb12cb1f7b8b from pending
12:15:27.200 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
12:15:27.204 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:27.209 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.209 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.212 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268946817024001) for scanner KuduScanner(table=replication_test_table, tablet=b056aa396cbb436e990ec90ba0e51d5b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.212 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8a92cf60c600602b5f39cf606254ec977e24b0c05e5ca58f0817b56ee8d30677]
12:15:27.213 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8a92cf60c600602b5f39cf606254ec977e24b0c05e5ca58f0817b56ee8d30677]
12:15:27.213 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:15:27.213 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:15:27.214 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8a92cf60c600602b5f39cf606254ec977e24b0c05e5ca58f0817b56ee8d30677 finished by subtask 1; deferring removal (restored in pending)
12:15:27.215 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.215 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.216 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:27.217 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:27.220 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.222 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.223 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb98f2fd6, L:/127.0.0.1:43550 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:27.249 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false, responseScanTimestamp = 7305268946817024001) for scanner KuduScanner(table=replication_test_table, tablet=07e34f4f54584c2e8db79b3792981f0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.250 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [95322cf5e64234da7cc09b225ba44e86410b87813323c6ef4642f5a3b3ded796]
12:15:27.250 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:15:27.262 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:27.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:27.263 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:15:27.266 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:15:27.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.272 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.273 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.273 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.273 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.278 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.278 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.278 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.279 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.279 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.279 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.279 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.280 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.280 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.281 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.281 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.281 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.282 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.284 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [95322cf5e64234da7cc09b225ba44e86410b87813323c6ef4642f5a3b3ded796]
12:15:27.285 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 95322cf5e64234da7cc09b225ba44e86410b87813323c6ef4642f5a3b3ded796 finished by subtask 0; deferring removal (restored in pending)
12:15:27.288 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:15:27.288 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.289 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:15:27.289 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:27.290 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:27.294 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.303 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.304 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.304 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.304 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.305 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.305 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.305 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.306 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.308 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a812d211a3744a15bae682bb9b5592f5 for table 'replication_test_table' with partition [<start>, 0x80000064)
12:15:27.308 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 657dee8f9cfb4ce992876c093ff02768 for table 'replication_test_table' with partition [0x80000064, 0x800000C8)
12:15:27.317 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet edaa4fbdcd2f4380a4915c1c0b0883f2 for table 'replication_test_table' with partition [0x800000C8, <end>)
12:15:27.317 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=299999, tablet=a812d211a3744a15bae682bb9b5592f5@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=299999, tablet=657dee8f9cfb4ce992876c093ff02768@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}, Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=299999, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2@[6a70185538824df48992807d60b77e4b(127.19.223.195:41151),8405c6dcf75f4c55821f8d76dd841e8a(127.19.223.193:34773),ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)[L]]}]
12:15:27.336 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:27.336 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:27.336 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:15:27.336 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:15:27.352 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.352 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.358 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.358 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.364 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.375 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:27.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:27.375 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:15:27.376 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:15:27.421 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.421 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.431 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.431 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.441 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.464 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.490 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:27.490 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:27.490 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:27.491 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.491 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.491 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.491 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:27.502 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.502 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.508 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.509 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.513 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.572 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.572 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.576 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:27.576 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:27.576 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:27.576 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.576 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.576 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.576 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.576 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:27.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.577 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.577 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:27.576 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:27.578 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:27.580 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.580 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.586 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.641 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.642 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.646 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.654 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512927661 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:27.665 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=15, operationSize=950, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@b9fad2d, flushNotification=Deferred@2067287542(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:15:27.666 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] connecting to peer
12:15:27.675 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] Successfully connected to peer
12:15:27.710 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.711 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.716 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.716 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.741 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:27.742 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:27.742 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:27.742 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.742 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.742 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.743 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.743 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:27.743 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:27.744 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:27.744 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:27.744 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:27.744 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:27.744 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:27.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:27.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:27.745 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:27.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:27.745 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:27.745 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:27.745 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:27.755 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:27.759 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xca79113a, L:/127.0.0.1:58776 - R:/127.19.223.194:44817] using TOKEN/null
12:15:27.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.780 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.781 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.786 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.791 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.821 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:27.822 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:27.822 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:27.822 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.822 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.822 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:27.822 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.822 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.822 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:27.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.823 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.823 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:27.823 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:27.847 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.848 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.860 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.860 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.866 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.876 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:27.876 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:27.876 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:27.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:27.877 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.877 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:27.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:27.878 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:27.922 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.923 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:27.927 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:27.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:27.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:27.932 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:27.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.933 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.933 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.933 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.933 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.933 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.933 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.933 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:27.940 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.964 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:27.972 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:27.972 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:27.972 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:27.973 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.973 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:27.973 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.973 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.973 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:27.973 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:27.973 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:27.983 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 5273b45840e0da6e6ca30141a2a11dd8 (2224 bytes, checkpointDuration=322 ms, finalizationTime=0 ms).
12:15:27.987 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:15:27.987 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 8a92cf60c600602b5f39cf606254ec977e24b0c05e5ca58f0817b56ee8d30677 from pending
12:15:27.987 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 2 complete: removed split 95322cf5e64234da7cc09b225ba44e86410b87813323c6ef4642f5a3b3ded796 from pending
12:15:27.987 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 2 complete: removed 2 finished splits from enumerator state
12:15:27.999 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:27.999 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:28.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.006 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:28.012 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.015 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:28.020 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:28.022 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:28.025 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:28.029 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:28.032 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cee5e91d959f4024be25f1424343d851
12:15:28.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=07e34f4f54584c2e8db79b3792981f0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.054 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 07e34f4f54584c2e8db79b3792981f0c for partition [<start>, 0x80000064) with scanner id null
12:15:28.061 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b056aa396cbb436e990ec90ba0e51d5b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.061 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b056aa396cbb436e990ec90ba0e51d5b for partition [0x80000064, 0x800000C8) with scanner id null
12:15:28.071 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b734e6fab27c4d5bb040bf1c1b00ac30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.082 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.082 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:28.088 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.088 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:28.093 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.096 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:28.096 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.097 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.097 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:28.097 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:28.098 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.098 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:28.133 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:28.134 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:28.134 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:28.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.135 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.135 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.135 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.135 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.135 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.136 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:28.150 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=07e34f4f54584c2e8db79b3792981f0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.150 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 07e34f4f54584c2e8db79b3792981f0c for partition [<start>, 0x80000064) with scanner id null
12:15:28.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512928161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:28.172 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b056aa396cbb436e990ec90ba0e51d5b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.173 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b056aa396cbb436e990ec90ba0e51d5b for partition [0x80000064, 0x800000C8) with scanner id null
12:15:28.174 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:15:28.176 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:15:28.195 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:28.196 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:28.196 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:28.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.197 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.197 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.197 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.197 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.197 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.198 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b734e6fab27c4d5bb040bf1c1b00ac30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.198 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:28.204 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:28.204 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:28.205 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:28.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.205 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.206 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.206 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.206 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.206 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.206 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.206 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:28.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 15 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=a812d211a3744a15bae682bb9b5592f5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.217 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet a812d211a3744a15bae682bb9b5592f5 for partition [<start>, 0x80000064) with scanner id null
12:15:28.236 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=657dee8f9cfb4ce992876c093ff02768, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.237 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 657dee8f9cfb4ce992876c093ff02768 for partition [0x80000064, 0x800000C8) with scanner id null
12:15:28.246 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=edaa4fbdcd2f4380a4915c1c0b0883f2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.247 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state READY
12:15:28.247 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state READY
12:15:28.247 [DEBUG - main] (Connection.java:575) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] disconnecting while in state READY
12:15:28.247 [DEBUG - main] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state READY
12:15:28.247 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:28.248 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:28.248 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:28.248 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:28.249 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:28.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:28.250 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:28.251 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:15:28.252 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
12:15:28.252 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:15:28.253 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] handling channelInactive
12:15:28.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] cleaning up while in state READY due to: connection closed
12:15:28.253 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-3
12:15:28.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.253413 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20642
12:15:28.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:28.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:28.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:28.373260 20908 connection.cc:573] client connection to 127.19.223.193:34773 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:15:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:28.373826 20908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:15:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.390093 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20858
12:15:28.444 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] handling channelInactive
12:15:28.445 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] cleaning up while in state READY due to: connection closed
12:15:28.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.445130 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 21027
12:15:28.450 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:28.450 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:28.450 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:28.450 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.451 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.451 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.451 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:28.463 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:28.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:28.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:28.473 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:28.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.474 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.474 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.474 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:28.479 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:28.481 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d13ca96cea3139aac5d306ae56f3e062faf4ed12e5b9a6d704be35bf9fff5009'}]
12:15:28.482 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='8ee4a4c6437b560f277d450cfb03465c5adb7e873ce30e1e2508598a8c5ffc33'}]
12:15:28.482 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:28.484 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:28.484 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:15:28.484 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=298060, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:28.486 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e9c4d5bb6e5e9dbacd1b5b6e9c8d865de2b21aa081b15e91b3a2daf30d320cc8'}]
12:15:28.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.486555 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20363
12:15:28.490 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:15:28.491 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=298060, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:28.493 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:28.493 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:15:28.493 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=298060, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:28.533 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:28.533 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:28.537 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:28.549 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:28.553 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:28.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:28.553 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:28.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:28.555 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:28.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:28.556 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.223.254:42193(127.19.223.254:42193)] handling channelInactive
12:15:28.556 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state READY due to: connection closed
12:15:28.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.567700 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20433
12:15:28.574 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:28.575 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:28.577 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:28.580 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:28.588 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:28.591 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:28.594 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd4f6a67e, L:/127.0.0.1:43564 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:28.600 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:28.601 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:28.603 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x83f6d6cf, L:/127.0.0.1:43578 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:28.604 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5fbccb2c, L:/127.0.0.1:43588 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:28.613 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:28.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:28.613 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:28.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:28.614 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:28.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:28.615 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.223.253:37033(127.19.223.253:37033)] handling channelInactive
12:15:28.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state READY due to: connection closed
12:15:28.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:28.617715 20351 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20509
12:15:28.621 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268955009024001) for scanner KuduScanner(table=replication_test_table, tablet=b056aa396cbb436e990ec90ba0e51d5b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.621 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [e9c4d5bb6e5e9dbacd1b5b6e9c8d865de2b21aa081b15e91b3a2daf30d320cc8]
12:15:28.621 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e9c4d5bb6e5e9dbacd1b5b6e9c8d865de2b21aa081b15e91b3a2daf30d320cc8]
12:15:28.622 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:15:28.622 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:15:28.623 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e9c4d5bb6e5e9dbacd1b5b6e9c8d865de2b21aa081b15e91b3a2daf30d320cc8 finished by subtask 2; deferring removal (restored in pending)
12:15:28.623 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:28.624 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:28.625 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268955009024001) for scanner KuduScanner(table=replication_test_table, tablet=b734e6fab27c4d5bb040bf1c1b00ac30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.626 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [8ee4a4c6437b560f277d450cfb03465c5adb7e873ce30e1e2508598a8c5ffc33]
12:15:28.630 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [8ee4a4c6437b560f277d450cfb03465c5adb7e873ce30e1e2508598a8c5ffc33]
12:15:28.630 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:15:28.630 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:15:28.630 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:28.631 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:28.632 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 8ee4a4c6437b560f277d450cfb03465c5adb7e873ce30e1e2508598a8c5ffc33 finished by subtask 1; deferring removal (restored in pending)
12:15:28.647 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:28.647 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:28.647 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:28.647 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:15:28.649 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:28.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:28.650 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:15:28.650 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:28.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512928662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:28.658 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.223.252:41911(127.19.223.252:41911)] handling channelInactive
12:15:28.663 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state READY due to: connection closed
12:15:28.674 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 5273b45840e0da6e6ca30141a2a11dd8 (2880 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:15:28.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:15:28.676 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split e9c4d5bb6e5e9dbacd1b5b6e9c8d865de2b21aa081b15e91b3a2daf30d320cc8 from pending
12:15:28.677 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 8ee4a4c6437b560f277d450cfb03465c5adb7e873ce30e1e2508598a8c5ffc33 from pending
12:15:28.677 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 2 finished splits from enumerator state
12:15:28.689 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:28.690 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:28.690 [DEBUG - pool-260-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:28.690 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.690 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:28.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.690 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:28.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:28.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:28.691 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26319), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [68ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [73ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [93ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [642ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1644ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2863ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5002ms] refreshing cache from master, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5003ms] too many traces: truncated at 100 traces, deferred=Deferred@712153502(state=PENDING, result=null, callback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342), errback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342)))
12:15:28.692 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:15:28.692 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26319), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [68ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [73ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [93ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [642ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1644ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2863ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5002ms] refreshing cache from master, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5003ms] too many traces: truncated at 100 traces, deferred=Deferred@712153502(state=PENDING, result=null, callback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342), errback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:28.692 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:15:28.696 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:15:28.699 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26319), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [68ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [73ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [93ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [104ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [402ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [403ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [640ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [642ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1644ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2860ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2862ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2863ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5002ms] refreshing cache from master, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5002ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5003ms] too many traces: truncated at 100 traces, deferred=Deferred@712153502(state=PENDING, result=null, callback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342), errback=(continuation of Deferred@1291486505 after retry RPC after error@1496116712) -> (continuation of Deferred@2069403194 after retry RPC after error@1171807910) -> (continuation of Deferred@1569937657 after retry RPC after error@1676590350) -> (continuation of Deferred@1547181583 after retry RPC after error@1527928384) -> (continuation of Deferred@478255435 after retry RPC after error@177291544) -> (continuation of Deferred@382074403 after retry RPC after error@1605110509) -> (continuation of Deferred@1333238674 after retry RPC after error@1341033189) -> (continuation of Deferred@1994609117 after retry RPC after error@1235732110) -> (continuation of Deferred@989822755 after retry RPC after error@24994619) -> (continuation of Deferred@1836889968 after retry RPC after error@437821415) -> (continuation of Deferred@1541402080 after retry RPC after error@827406619) -> (continuation of Deferred@958324598 after retry RPC after error@1739036693) -> (continuation of Deferred@1135856108 after retry RPC after error@2064820576) -> (continuation of Deferred@876100635 after retry RPC after error@1862561209) -> (continuation of Deferred@849687836 after retry RPC after error@1553122177) -> (continuation of Deferred@700445932 after retry RPC after error@1704603079) -> (continuation of Deferred@2123164093 after retry RPC after error@885568294) -> (continuation of Deferred@1652963783 after retry RPC after error@1447482437) -> (continuation of Deferred@1327373873 after retry RPC after error@1044305271) -> (continuation of Deferred@1831177078 after retry RPC after error@228691563) -> (continuation of Deferred@846325368 after retry RPC after error@2058094636) -> (continuation of Deferred@991121972 after retry RPC after error@977293803) -> (continuation of Deferred@121578237 after retry RPC after error@491304798) -> (continuation of Deferred@1013695537 after retry RPC after error@68949342)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:28.701 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:28.702 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
12:15:28.703 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:15:28.703 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RUNNING to RESTARTING.
12:15:28.732 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:28.732 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:28.733 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:28.733 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.733 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.733 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:28.733 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.733 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.733 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:28.733 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.734 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.734 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:28.734 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:28.753 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:28.753 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:28.754 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:28.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:28.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:28.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:28.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:28.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:28.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:28.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:28.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:28.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:28.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:28.768 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:28.768 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:28.768 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:28.769 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:28.769 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:28.769 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:28.769 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:28.769 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:28.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:28.769 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:28.769 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:28.770 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:28.770 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:28.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:28.840 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:28.840 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:28.840 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:28.841 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.841 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.841 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:28.843 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.843 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.843 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:28.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:28.843 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:28.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:28.947 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268955009024001) for scanner KuduScanner(table=replication_test_table, tablet=07e34f4f54584c2e8db79b3792981f0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:28.952 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [d13ca96cea3139aac5d306ae56f3e062faf4ed12e5b9a6d704be35bf9fff5009]
12:15:28.953 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d13ca96cea3139aac5d306ae56f3e062faf4ed12e5b9a6d704be35bf9fff5009]
12:15:28.954 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:15:28.954 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:15:28.955 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d13ca96cea3139aac5d306ae56f3e062faf4ed12e5b9a6d704be35bf9fff5009 finished by subtask 3; deferring removal (restored in pending)
12:15:28.955 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:28.955 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:28.988 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:28.989 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:28.989 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:15:28.989 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:15:29.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512929162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:29.176 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 5273b45840e0da6e6ca30141a2a11dd8 (1600 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:15:29.178 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:15:29.178 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split d13ca96cea3139aac5d306ae56f3e062faf4ed12e5b9a6d704be35bf9fff5009 from pending
12:15:29.178 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 1 finished splits from enumerator state
12:15:29.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:29.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:29.416 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:29.416 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:29.417 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:29.417 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:29.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:29.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:29.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:29.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:29.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:29.418 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:29.418 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:29.418 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:29.418 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:29.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512929662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:29.680 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:15:29.682 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:15:29.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:29.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:29.903 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.903 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.903 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.904 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.904 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.904 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.904 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.904 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.904 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.905 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.905 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.905 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.905 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.905 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27489), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [621ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [622ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1002ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2702ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2901ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2902ms] too many traces: truncated at 100 traces, deferred=Deferred@544089839(state=PENDING, result=null, callback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716), errback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716)))
12:15:29.906 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.906 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.906 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.907 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.907 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.907 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27489), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [621ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [622ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1002ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2702ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2901ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2902ms] too many traces: truncated at 100 traces, deferred=Deferred@544089839(state=PENDING, result=null, callback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716), errback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27489), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [621ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [622ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1002ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2702ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2901ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2902ms] too many traces: truncated at 100 traces, deferred=Deferred@544089839(state=PENDING, result=null, callback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716), errback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:29.907 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.907 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.907 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.908 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.908 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.911 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27489), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [621ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [622ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1002ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2702ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2901ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2902ms] too many traces: truncated at 100 traces, deferred=Deferred@544089839(state=PENDING, result=null, callback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716), errback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27489), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [19ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [31ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [31ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [60ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [61ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [62ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [81ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [102ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [102ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [122ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [122ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [142ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [143ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [143ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [162ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [162ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [382ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [382ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [621ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [622ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [622ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1000ms] refreshing cache from master, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1001ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1002ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1002ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2701ms] refreshing cache from master, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2702ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2702ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2901ms] refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2902ms] too many traces: truncated at 100 traces, deferred=Deferred@544089839(state=PENDING, result=null, callback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716), errback=(continuation of Deferred@1917918559 after retry RPC after error@956397458) -> (continuation of Deferred@1268253725 after retry RPC after error@445651679) -> (continuation of Deferred@1624332087 after retry RPC after error@1381892440) -> (continuation of Deferred@1508728802 after retry RPC after error@1135735010) -> (continuation of Deferred@691240780 after retry RPC after error@197525491) -> (continuation of Deferred@954508070 after retry RPC after error@1948152376) -> (continuation of Deferred@1189460712 after retry RPC after error@1660682144) -> (continuation of Deferred@2132512074 after retry RPC after error@2022944547) -> (continuation of Deferred@323647523 after retry RPC after error@779191061) -> (continuation of Deferred@220408396 after retry RPC after error@1756132988) -> (continuation of Deferred@677875754 after retry RPC after error@179099416) -> (continuation of Deferred@516554059 after retry RPC after error@366831480) -> (continuation of Deferred@19878697 after retry RPC after error@1842823171) -> (continuation of Deferred@1009109847 after retry RPC after error@1119722764) -> (continuation of Deferred@972040297 after retry RPC after error@1861263372) -> (continuation of Deferred@2082320886 after retry RPC after error@1382422148) -> (continuation of Deferred@1785581505 after retry RPC after error@32956992) -> (continuation of Deferred@284516745 after retry RPC after error@1917159205) -> (continuation of Deferred@1993497963 after retry RPC after error@1073759507) -> (continuation of Deferred@2067959219 after retry RPC after error@627069265) -> (continuation of Deferred@1094543763 after retry RPC after error@64459898) -> (continuation of Deferred@1821884070 after retry RPC after error@1264226492) -> (continuation of Deferred@1635846581 after retry RPC after error@1590310331) -> (continuation of Deferred@268030538 after retry RPC after error@272202873) -> (continuation of Deferred@2040271722 after retry RPC after error@1995740687) -> (continuation of Deferred@928936217 after retry RPC after error@1818167615) -> (continuation of Deferred@1975599261 after retry RPC after error@660075716)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:29.911 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:29.911 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
12:15:29.912 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
12:15:29.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:15:29.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
12:15:29.912 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:15:29.912 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
12:15:29.912 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:15:29.913 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
12:15:29.913 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:15:29.925 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.925 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.925 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.934 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.947 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.947 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.947 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.948 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.948 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.948 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.948 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.948 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.948 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.948 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.952 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:29.952 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:29.952 [DEBUG - pool-248-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:29.952 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:29.952 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:29.952 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:29.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:29.953 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:29.953 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:29.953 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:29.953 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:29.953 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:29.953 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:29.965 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.965 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.965 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.965 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.965 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:29.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.965 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.965 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:29.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:29.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:29.966 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:29.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:29.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:29.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:29.965 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.968 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:15:29.965 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:29.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.968 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
12:15:29.968 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.968 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:15:29.968 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.968 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:29.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:29.969 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:29.969 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:29.985 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:29.985 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:29.985 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:29.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:29.985 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.986 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:29.986 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.986 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.986 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:29.986 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:29.998 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:15:29.998 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:15:29.998 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:15:30.004 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:15:30.004 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:15:30.004 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:15:30.018 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:15:30.018 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:15:30.018 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:15:30.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.023 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.023 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.023 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.023 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.024 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.024 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.027 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:15:30.027 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:15:30.027 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:15:30.038 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:15:30.038 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
12:15:30.038 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:15:30.038 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
12:15:30.039 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:15:30.040 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:30.040 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:15:30.040 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:30.041 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c0988648dfcd43275159a42b4d64d13e
12:15:30.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:30Z chronyd exiting
12:15:30.072 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.073 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.073 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.073 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.073 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.073 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.073 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.073 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.074 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.074 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.074 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.073 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.074 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512930162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:30.173 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:30.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:15:30.183 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.183 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.183 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.184 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.243 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.243 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.243 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.243 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.243 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.244 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.244 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.244 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.244 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.244 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.244 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.244 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:30.271 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:30.272 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:30.272 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:30.273 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:30.273 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:30.273 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:30.273 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:30.273 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:30.273 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:30.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:30.274 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:30.274 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:30.274 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:30.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.303 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.304 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.304 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.304 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.304 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:30.472 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 0734908f759a4125b01da8e2ee88afa8
12:15:30.479 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='617765ad44ea594a0213ca777ce158323b03d1db9bf14b7bc798eda9363c0488'}]
12:15:30.480 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.480 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:15:30.481 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x80000064, ttl=296066, tablet=07e34f4f54584c2e8db79b3792981f0c@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719),431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)[L]]}]
12:15:30.482 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='46b867cde20b6088e16c2555d0cca24cbe06595b585f10cdc13e947c92067c07'}]
12:15:30.483 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.483 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:15:30.483 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e33cb1edde5c18413454ae35b57a57b89a36f01dc26891ea45de8dadb7741420'}]
12:15:30.484 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x80000064, upperBoundPartitionKey=0x800000C8, ttl=296066, tablet=b056aa396cbb436e990ec90ba0e51d5b@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:30.485 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.485 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:15:30.485 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x800000C8, upperBoundPartitionKey=0x, ttl=296066, tablet=b734e6fab27c4d5bb040bf1c1b00ac30@[2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)[L],431ead545e0a472b969830c473c49da6(127.19.5.66:38845),ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)]}]
12:15:30.494 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:30.494 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:30.500 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] connecting to peer
12:15:30.501 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:30.503 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:30.513 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] Successfully connected to peer
12:15:30.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:30.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:30.516 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:30.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.517 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.517 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.517 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.517 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.517 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.517 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.517 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.517 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.517 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:30.520 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:30.529 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:30.532 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.19.5.67
12:15:30.547 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:30.548 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:30.550 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x95bfd7b8, L:/127.0.0.1:47120 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:30.552 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x8899ce56, L:/127.0.0.1:47126 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:30.554 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:15:30.558 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa6fb97d1, L:/127.0.0.1:47108 - R:/127.19.5.67:38719] using SASL/PLAIN
12:15:30.561 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268963201024001) for scanner KuduScanner(table=replication_test_table, tablet=b056aa396cbb436e990ec90ba0e51d5b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:30.561 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [46b867cde20b6088e16c2555d0cca24cbe06595b585f10cdc13e947c92067c07]
12:15:30.562 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [46b867cde20b6088e16c2555d0cca24cbe06595b585f10cdc13e947c92067c07]
12:15:30.562 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:15:30.562 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:15:30.563 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 46b867cde20b6088e16c2555d0cca24cbe06595b585f10cdc13e947c92067c07 finished by subtask 2; deferring removal (restored in pending)
12:15:30.563 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:30.564 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:30.566 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:30.566 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:30.566 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:30.567 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:15:30.586 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268963201024001) for scanner KuduScanner(table=replication_test_table, tablet=07e34f4f54584c2e8db79b3792981f0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:30.587 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [617765ad44ea594a0213ca777ce158323b03d1db9bf14b7bc798eda9363c0488]
12:15:30.587 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [617765ad44ea594a0213ca777ce158323b03d1db9bf14b7bc798eda9363c0488]
12:15:30.587 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:15:30.587 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:15:30.588 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 617765ad44ea594a0213ca777ce158323b03d1db9bf14b7bc798eda9363c0488 finished by subtask 0; deferring removal (restored in pending)
12:15:30.589 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:30.589 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:30.598 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:30.598 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:30.598 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:30.598 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:15:30.602 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:30.603 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:30.603 [DEBUG - pool-258-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:30.603 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.603 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.603 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:30.603 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.603 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.603 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.603 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:30.603 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.603 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:30.603 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:30.633 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:30.634 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:30.634 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:30.634 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.634 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.634 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:30.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:30.635 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.635 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.635 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:30.635 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:30.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512930662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:30.671 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 5273b45840e0da6e6ca30141a2a11dd8 (2880 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:30.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:15:30.672 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 617765ad44ea594a0213ca777ce158323b03d1db9bf14b7bc798eda9363c0488 from pending
12:15:30.672 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 46b867cde20b6088e16c2555d0cca24cbe06595b585f10cdc13e947c92067c07 from pending
12:15:30.673 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 2 finished splits from enumerator state
12:15:30.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:30.789 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305268963201024001) for scanner KuduScanner(table=replication_test_table, tablet=b734e6fab27c4d5bb040bf1c1b00ac30, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:15:30.789 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [e33cb1edde5c18413454ae35b57a57b89a36f01dc26891ea45de8dadb7741420]
12:15:30.790 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e33cb1edde5c18413454ae35b57a57b89a36f01dc26891ea45de8dadb7741420]
12:15:30.791 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:15:30.791 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:15:30.791 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] disconnecting while in state READY
12:15:30.791 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:30.793 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e33cb1edde5c18413454ae35b57a57b89a36f01dc26891ea45de8dadb7741420 finished by subtask 1; deferring removal (restored in pending)
12:15:30.801 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] handling channelInactive
12:15:30.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2f3686b6a7f84623a8960571797785ee(127.19.5.67:38719)] cleaning up while in state READY due to: connection closed
12:15:30.801 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:15:30.801 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:15:30.817 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:15:30.818 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:15:30.819 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:15:30.819 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:15:30.819 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
12:15:30.820 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
12:15:30.820 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:15:30.821 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
12:15:30.821 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
12:15:30.821 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:15:30.821 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:30.822 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:30.823 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:30.823 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
12:15:30.823 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:15:30.823 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:30.823 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:15:30.824 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:15:30.824 [INFO - Thread-50] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:15:30.825 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:15:30.825 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:15:30.825 [DEBUG - Thread-50] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:15:30.825 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:15:30.826 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:30.827 [INFO - Thread-50] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:15:30.827 [INFO - Thread-50] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:15:30.828 [DEBUG - Thread-50] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.829 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:15:30.829 [INFO - Thread-50] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:30.830 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:15:30.830 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:30.830 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:30.830 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:30.830 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:30.830 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
12:15:30.830 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@bb794bc
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
12:15:30.831 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
12:15:30.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a87cdb0
12:15:30.832 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:15:30.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:30.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:15:30.832 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:15:30.833 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:15:30.833 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:15:30.834 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:15:30.834 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
12:15:30.834 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
12:15:30.834 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@77721e7d
12:15:30.835 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:30.835 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:15:30.835 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:15:30.835 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:15:30.838 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@145a70ae
12:15:30.839 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.840 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
12:15:30.840 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
12:15:30.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@106ba06d
12:15:30.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:30.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:15:30.841 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:15:30.841 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:15:30.844 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5980e72a
12:15:30.846 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.849 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@38dc0a61
12:15:30.850 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@46994f71
12:15:30.851 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:30.857 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:30.865 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.865 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.866 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.866 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:30.870 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.878 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.884 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.885 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.885 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.886 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.891 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.905 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:30.905 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.905 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.905 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.906 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.913 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.914 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.914 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.914 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.914 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.916 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.916 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.925 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:30.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.925 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.925 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.929 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.929 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.929 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.930 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.930 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.930 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.930 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.931 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.931 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.931 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.932 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.932 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.932 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.933 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.933 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.933 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.933 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.933 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.937 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.937 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.937 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.937 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:30.937 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.938 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.938 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.939 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.940 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.940 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.940 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.940 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.940 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.940 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.941 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.941 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.940 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.941 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.941 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.945 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.945 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.946 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.946 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.946 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.946 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.946 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.946 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.946 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.946 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.947 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:30.947 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.947 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.947 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.947 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.948 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.949 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.951 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.952 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.953 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.953 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.953 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.954 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.954 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.954 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.954 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.964 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.966 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.966 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.966 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.966 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.967 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.967 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.968 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.969 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.969 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.969 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.969 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.973 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:30.973 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:30.974 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:30.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:30.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:30.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:30.974 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:30.974 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:30.974 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:30.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:30.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:30.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:30.975 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:30.977 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.978 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.978 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.981 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.982 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.982 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.982 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.982 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.982 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.985 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.985 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.985 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.986 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.986 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.986 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.986 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.986 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.986 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.986 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.986 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.989 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.989 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.989 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.989 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.990 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.990 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.990 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.990 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:30.991 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.991 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.991 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.991 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.991 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.991 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.991 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:30.991 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.991 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.992 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.992 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.992 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.992 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.992 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:30.992 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:30.993 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.993 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.993 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:30.993 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.993 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.993 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:30.993 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:30.993 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:30.994 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.994 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.994 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:30.994 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:30.995 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.995 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.995 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:30.995 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.996 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.996 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:30.996 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.005 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.005 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.005 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.005 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.006 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.006 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.006 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.006 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.006 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.006 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.007 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.007 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.007 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.007 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.007 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.007 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.007 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.008 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.008 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.008 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.008 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.009 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.009 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.009 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.009 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.010 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.010 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.011 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.011 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.011 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.011 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.011 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.011 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.011 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.011 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.011 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.012 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.012 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.012 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.012 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.013 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.013 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.013 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.013 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.013 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.013 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.025 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.025 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.025 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.026 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.026 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.026 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.026 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.026 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.026 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.026 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.026 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.026 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.026 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.026 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.027 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.027 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.027 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.027 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.027 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.027 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.027 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.027 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.027 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.027 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.028 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.028 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.028 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.028 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.028 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.028 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.028 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.028 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.030 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RESTARTING to RUNNING.
12:15:31.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.031 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job c0988648dfcd43275159a42b4d64d13e from Checkpoint 61 @ 1783512870892 for c0988648dfcd43275159a42b4d64d13e located at file:/tmp/junit5149282460191757602/checkpoints/c0988648dfcd43275159a42b4d64d13e/chk-61.
12:15:31.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.032 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.032 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:15:31.032 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:15:31.032 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.032 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.032 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.032 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.033 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
12:15:31.033 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
12:15:31.033 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:15:31.034 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:31.034 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:15:31.034 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
12:15:31.034 [INFO - Thread-51] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:15:31.035 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state TERMINATED
12:15:31.035 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state TERMINATED
12:15:31.035 [DEBUG - Thread-51] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state TERMINATED
12:15:31.035 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:15:31.035 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:31.036 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:31.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
12:15:31.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:15:31.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to SCHEDULED.
12:15:31.037 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:31.037 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from SCHEDULED to DEPLOYING.
12:15:31.037 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #3) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:15:31.037 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to SCHEDULED.
12:15:31.038 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:31.038 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from SCHEDULED to DEPLOYING.
12:15:31.038 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #3) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:15:31.041 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:15:31.067 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.067 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.067 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.067 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.067 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.067 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.068 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.068 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.068 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.069 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.069 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.069 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.069 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.069 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.069 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.069 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.069 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.069 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.070 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.070 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.070 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.071 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.071 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.071 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.067 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.070 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.071 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.071 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.071 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.072 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.072 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.072 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.070 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.072 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.072 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:15:31.070 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.073 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.069 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.073 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.073 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.073 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.072 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.073 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:15:31.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.074 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
12:15:31.074 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
12:15:31.074 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:15:31.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.075 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.075 [INFO - Thread-51] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:15:31.076 [INFO - Thread-51] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:15:31.079 [DEBUG - Thread-51] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:31.079 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
12:15:31.079 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
12:15:31.080 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5aeca80b
12:15:31.080 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:31.081 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:31.081 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:15:31.081 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:15:31.083 [INFO - Thread-51] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:31.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.086 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.086 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.087 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.087 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.087 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.087 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.087 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.087 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.087 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.090 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.090 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.091 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.091 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.091 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.091 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.091 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.091 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.091 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.091 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.091 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.091 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.091 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.096 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:15:31.097 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:15:31.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CREATED to DEPLOYING.
12:15:31.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) [DEPLOYING].
12:15:31.098 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fe9c7b8
12:15:31.099 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:31.099 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@61b1569b
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@44eac52
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:31.102 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:15:31.103 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from DEPLOYING to INITIALIZING.
12:15:31.103 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:15:31.105 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.105 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.105 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.106 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.106 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.106 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.106 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.106 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.107 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.107 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.107 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.107 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.108 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.109 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.109 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.109 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.109 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.109 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.106 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.110 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.110 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.110 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.110 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.111 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from CREATED to DEPLOYING.
12:15:31.111 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) [DEPLOYING].
12:15:31.112 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63f881f0
12:15:31.112 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:31.112 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:31.116 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:15:31.115 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:31.116 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:31.116 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:31.116 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:31.118 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:15:31.118 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from DEPLOYING to INITIALIZING.
12:15:31.126 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.126:41267(127.19.5.126:41267)] disconnecting while in state READY
12:15:31.126 [DEBUG - main] (Connection.java:575) [peer ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)] disconnecting while in state READY
12:15:31.126 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.124:34641(127.19.5.124:34641)] disconnecting while in state READY
12:15:31.126 [DEBUG - main] (Connection.java:575) [peer master-127.19.5.125:34511(127.19.5.125:34511)] disconnecting while in state READY
12:15:31.127 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.5.125:34511(127.19.5.125:34511)] handling channelInactive
12:15:31.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state READY due to: connection closed
12:15:31.127 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)] handling channelInactive
12:15:31.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ef7bb15de6bf4075800485dce5d135bb(127.19.5.65:45925)] cleaning up while in state READY due to: connection closed
12:15:31.128 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:31.128 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.128 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.128 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.128 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.128 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.129 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.129 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.129 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.129 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.132 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.132 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.132 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.132 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.137 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:15:31.137 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.5.124:34641(127.19.5.124:34641)] handling channelInactive
12:15:31.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state READY due to: connection closed
12:15:31.137 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-1
12:15:31.138 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
12:15:31.127 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.5.126:41267(127.19.5.126:41267)] handling channelInactive
12:15:31.139 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state READY due to: connection closed
12:15:31.139 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-2
12:15:31.140 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.140 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.138594 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 19799
12:15:31.145 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a723601
12:15:31.146 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@437e98e
12:15:31.146 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4ef859a3
12:15:31.147 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:31.147 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:31.150 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:31.175 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.176 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.176 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.176 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.176 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.175 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.177 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.177 [DEBUG - pool-262-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.177 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.177 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.178 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.178 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.178 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.179 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.179 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.179 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.179 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.179 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.179 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.179 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.181 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.181 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.181 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.182 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512931180 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:31.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.183 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.183 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.183 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.184 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28802), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [6ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [36ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [36ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [65ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [96ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [185ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [186ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [186ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [360ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [362ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [363ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [363ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [364ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [821ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [822ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1063ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2761ms] refreshing cache from master, [2761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2763ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2763ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [5080ms] refreshing cache from master, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5081ms] too many traces: truncated at 100 traces, deferred=Deferred@15381989(state=PENDING, result=null, callback=(continuation of Deferred@1045653876 after retry RPC after error@1533239224) -> (continuation of Deferred@1484960316 after retry RPC after error@227696980) -> (continuation of Deferred@682602843 after retry RPC after error@1768994153) -> (continuation of Deferred@607058217 after retry RPC after error@975742009) -> (continuation of Deferred@1868103502 after retry RPC after error@57656369) -> (continuation of Deferred@1356567236 after retry RPC after error@791543178) -> (continuation of Deferred@128435630 after retry RPC after error@2056574759) -> (continuation of Deferred@1985296131 after retry RPC after error@911496686) -> (continuation of Deferred@258440255 after retry RPC after error@1393999643) -> (continuation of Deferred@203716437 after retry RPC after error@416004122) -> (continuation of Deferred@746170808 after retry RPC after error@1248933195) -> (continuation of Deferred@1698725263 after retry RPC after error@546177621) -> (continuation of Deferred@1104894869 after retry RPC after error@46392712) -> (continuation of Deferred@1686723674 after retry RPC after error@876963380) -> (continuation of Deferred@802788570 after retry RPC after error@850119436) -> (continuation of Deferred@485370511 after retry RPC after error@59087840) -> (continuation of Deferred@1620680718 after retry RPC after error@201782458) -> (continuation of Deferred@1641094631 after retry RPC after error@1319424166) -> (continuation of Deferred@1670418604 after retry RPC after error@1476922176) -> (continuation of Deferred@836701059 after retry RPC after error@1503055102) -> (continuation of Deferred@1055138448 after retry RPC after error@640580615) -> (continuation of Deferred@1868888146 after retry RPC after error@8009852) -> (continuation of Deferred@529889857 after retry RPC after error@1250878448), errback=(continuation of Deferred@1045653876 after retry RPC after error@1533239224) -> (continuation of Deferred@1484960316 after retry RPC after error@227696980) -> (continuation of Deferred@682602843 after retry RPC after error@1768994153) -> (continuation of Deferred@607058217 after retry RPC after error@975742009) -> (continuation of Deferred@1868103502 after retry RPC after error@57656369) -> (continuation of Deferred@1356567236 after retry RPC after error@791543178) -> (continuation of Deferred@128435630 after retry RPC after error@2056574759) -> (continuation of Deferred@1985296131 after retry RPC after error@911496686) -> (continuation of Deferred@258440255 after retry RPC after error@1393999643) -> (continuation of Deferred@203716437 after retry RPC after error@416004122) -> (continuation of Deferred@746170808 after retry RPC after error@1248933195) -> (continuation of Deferred@1698725263 after retry RPC after error@546177621) -> (continuation of Deferred@1104894869 after retry RPC after error@46392712) -> (continuation of Deferred@1686723674 after retry RPC after error@876963380) -> (continuation of Deferred@802788570 after retry RPC after error@850119436) -> (continuation of Deferred@485370511 after retry RPC after error@59087840) -> (continuation of Deferred@1620680718 after retry RPC after error@201782458) -> (continuation of Deferred@1641094631 after retry RPC after error@1319424166) -> (continuation of Deferred@1670418604 after retry RPC after error@1476922176) -> (continuation of Deferred@836701059 after retry RPC after error@1503055102) -> (continuation of Deferred@1055138448 after retry RPC after error@640580615) -> (continuation of Deferred@1868888146 after retry RPC after error@8009852) -> (continuation of Deferred@529889857 after retry RPC after error@1250878448)))
12:15:31.188 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.189 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.191 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 5273b45840e0da6e6ca30141a2a11dd8 (1600 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:31.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.192 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:15:31.192 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split e33cb1edde5c18413454ae35b57a57b89a36f01dc26891ea45de8dadb7741420 from pending
12:15:31.192 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 1 finished splits from enumerator state
12:15:31.197 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#3] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.197 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.198176 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20010
12:15:31.199 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.199 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.199 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.200 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.205 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.205 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.206 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.206 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.210 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.213 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.213 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.213 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.213 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.214 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.214 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.216 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.217 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.217 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.217 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.220 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.225 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.225 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.225 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.225 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.225 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.225 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.226 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.226 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.226 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.226 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.226 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.226 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.227 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.227 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.227 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.227 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.227 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.228 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.228 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.229 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.229 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.229 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.229 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.231 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.231 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.232 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.232 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.232 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.233 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.233 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.233 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.233 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.233 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.233 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.235 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.236 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.236 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.236 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.237 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.238 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.238 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.238 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.238 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.239 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.239 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.241 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.243 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.241124 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 20210
12:15:31.243 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.244 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.245 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.245 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.245 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.245 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.245 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.245 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.245 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.251 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.251 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.251 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.251 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.251 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.251 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.251 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.251 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.251 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.251 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.251 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.251 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.252 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.252 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.253 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.253 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.253 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.253 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.253 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.253 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.253 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.253 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.253 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.254 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.254 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.254 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.254 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.254 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.254 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.254 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.254 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.254 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.255 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.255 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.260 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.260 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.260 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.260 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.261 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.261 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.261 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.261 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.261 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.261 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.261 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.261 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.266 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.266 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.266 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.267 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.267 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.267 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.267 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.267 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.267 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.267 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.267 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.267 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.267 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.267 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.267 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.267 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.268 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.271 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.271 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.271 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.272 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.272 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.272 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.272 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.272 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.272 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.272 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.272 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.272 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.273 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.272 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.273 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.273 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.273 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.273 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.273 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.273 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.273 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.273 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.273 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.273 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.273 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.276 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#3] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.277 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.277 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.277 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.281 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.281 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.281 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.281 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.281 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.281 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.281 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.285 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.285 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.285 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.286 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.286 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.286 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.287 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.290 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.290 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.290 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.291358 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 19489
12:15:31.292 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.292 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.292 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.292 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.292 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.293 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.293 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.293 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.294 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.296 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.297 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.297 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.297 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.299 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.300 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.300 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.306 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.306 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.307 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.307 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.307 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.307 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.307 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.307 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.307 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.307 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.307 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.307 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.308 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.309 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.309 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.309 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.309 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.312 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.312 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.312 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.312 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.313 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.313 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.313 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.313 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.313 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.313 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.313 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.313 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.313 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.313 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.316 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.316 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.316 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.317 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.317 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.317 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.317 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.317 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.320 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.321 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.321 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.321 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.321 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.321 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.321 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.321 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.321 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.321 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.321 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.321 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.321 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.321 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.321 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.19.5.126:41267(127.19.5.126:41267)] handling channelInactive
12:15:31.322 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state READY due to: connection closed
12:15:31.322 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.322 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.322 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.322 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.323 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.323038 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 19559
12:15:31.323 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.323 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.323 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.324 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.324 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.324 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.324 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.329 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.329 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.330 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.330 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.330 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.330 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.330 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.331 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.333 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.333 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.333 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.333 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.341 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.342 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.342 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.342 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.342 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.346 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.346 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.346 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.347 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.347 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.347 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.347 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.347 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.347 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.347 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.347 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.347 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.347 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.349 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.349 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.349 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.349 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.349 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.349 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.349 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.349 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.349 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.349 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.349 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.349 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.350 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.352 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.19.5.125:34511(127.19.5.125:34511)] handling channelInactive
12:15:31.352 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state READY due to: connection closed
12:15:31.352 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.352 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.353 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.353 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:31.352804 19477 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 19674
12:15:31.353 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.353 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.353 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.353 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.353 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.354 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.354 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.354 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.361 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.361 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.361 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.361 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.361 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.361 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.361 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.361 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.361 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.361 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.361 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.362 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.362 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.368 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.368 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.369 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.369 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.369 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.369 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.369 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.372 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.373 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.373 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.373 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.373 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.373 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.373 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.373 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.373 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.373 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.373 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.373 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.373 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.373 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.373 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.373 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.373 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.373 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.373 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.374 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.374 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.374 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.374 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.380 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.380 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.380 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.380 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.380 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.380 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.380 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.381 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.381 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.381 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.381 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.381 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.381 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.381 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.381 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.381 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.381 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.381 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.381 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.381 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.381 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.381 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.381 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.381 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.381 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.381 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.382 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.19.5.124:34641(127.19.5.124:34641)] handling channelInactive
12:15:31.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state READY due to: connection closed
12:15:31.388 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.388 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.388 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.388 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.388 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.388 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.389 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.389 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.389 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.389 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.389 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.389 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.389 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.407 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.408 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.408 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.408 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.408 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.408 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.408 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.408 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.408 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.408 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.408 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.408 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.408 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.412 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.412 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.413 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.413 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.413 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.413 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.413 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.414 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.414 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.429 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.429 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.429 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.429 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.429 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.429 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.429 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.430 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.430 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.430 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.430 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.430 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.430 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.433 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.433 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.433 [DEBUG - pool-264-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.433 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.433 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.433 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.433 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.433 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.433 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.433 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.433 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.434 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.434 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29041), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [91ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [91ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [103ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [103ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [125ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [126ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [126ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [242ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [342ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [342ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [343ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [343ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [441ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [442ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [802ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [803ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [803ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1463ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1463ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2923ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2923ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [5121ms] refreshing cache from master, [5121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5122ms] too many traces: truncated at 100 traces, deferred=Deferred@1524457992(state=PENDING, result=null, callback=(continuation of Deferred@2059687863 after retry RPC after error@1057900138) -> (continuation of Deferred@18960037 after retry RPC after error@811446699) -> (continuation of Deferred@1761354232 after retry RPC after error@621549467) -> (continuation of Deferred@785588729 after retry RPC after error@1943932257) -> (continuation of Deferred@2049184003 after retry RPC after error@1070686483) -> (continuation of Deferred@138040313 after retry RPC after error@185393818) -> (continuation of Deferred@1375360753 after retry RPC after error@1704422436) -> (continuation of Deferred@1072193268 after retry RPC after error@1394369441) -> (continuation of Deferred@1347615469 after retry RPC after error@242895503) -> (continuation of Deferred@1939389002 after retry RPC after error@1126817523) -> (continuation of Deferred@74174953 after retry RPC after error@1478086105) -> (continuation of Deferred@1860527738 after retry RPC after error@1672930067) -> (continuation of Deferred@956862997 after retry RPC after error@803858408) -> (continuation of Deferred@1794806489 after retry RPC after error@1048595182) -> (continuation of Deferred@1130757905 after retry RPC after error@592680498) -> (continuation of Deferred@495035611 after retry RPC after error@569006783) -> (continuation of Deferred@1302050020 after retry RPC after error@1925597539) -> (continuation of Deferred@1660001436 after retry RPC after error@297606623) -> (continuation of Deferred@26322840 after retry RPC after error@1096575896) -> (continuation of Deferred@791091795 after retry RPC after error@1443740045) -> (continuation of Deferred@1521248691 after retry RPC after error@2022627797) -> (continuation of Deferred@1877782805 after retry RPC after error@1419160756) -> (continuation of Deferred@1842259556 after retry RPC after error@1660983929), errback=(continuation of Deferred@2059687863 after retry RPC after error@1057900138) -> (continuation of Deferred@18960037 after retry RPC after error@811446699) -> (continuation of Deferred@1761354232 after retry RPC after error@621549467) -> (continuation of Deferred@785588729 after retry RPC after error@1943932257) -> (continuation of Deferred@2049184003 after retry RPC after error@1070686483) -> (continuation of Deferred@138040313 after retry RPC after error@185393818) -> (continuation of Deferred@1375360753 after retry RPC after error@1704422436) -> (continuation of Deferred@1072193268 after retry RPC after error@1394369441) -> (continuation of Deferred@1347615469 after retry RPC after error@242895503) -> (continuation of Deferred@1939389002 after retry RPC after error@1126817523) -> (continuation of Deferred@74174953 after retry RPC after error@1478086105) -> (continuation of Deferred@1860527738 after retry RPC after error@1672930067) -> (continuation of Deferred@956862997 after retry RPC after error@803858408) -> (continuation of Deferred@1794806489 after retry RPC after error@1048595182) -> (continuation of Deferred@1130757905 after retry RPC after error@592680498) -> (continuation of Deferred@495035611 after retry RPC after error@569006783) -> (continuation of Deferred@1302050020 after retry RPC after error@1925597539) -> (continuation of Deferred@1660001436 after retry RPC after error@297606623) -> (continuation of Deferred@26322840 after retry RPC after error@1096575896) -> (continuation of Deferred@791091795 after retry RPC after error@1443740045) -> (continuation of Deferred@1521248691 after retry RPC after error@2022627797) -> (continuation of Deferred@1877782805 after retry RPC after error@1419160756) -> (continuation of Deferred@1842259556 after retry RPC after error@1660983929)))
12:15:31.460 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.460 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.460 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.461 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.461 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.461 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.461 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.461 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.461 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.461 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.461 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.461 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.461 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.461 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.462 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.462 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.487 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.487 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.487 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.487 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.488 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.488 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.488 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.488 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.488 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.488 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.488 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.488 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.488 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.527 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:31.527 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:31.527 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:31.527 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.527 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.527 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.528 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.528 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.528 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:31.528 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.528 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:31.528 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:31.528 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:31.533 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.533 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.534 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.534 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.560 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.561 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.561 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.561 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.561 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.561 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.561 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.561 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.561 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.561 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.561 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.561 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.568 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.568 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.568 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.569 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.569 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.569 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.569 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.569 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.569 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.569 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.569 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.569 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.569 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.573 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.573 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.573 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.574 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.581 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.581 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.582 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.582 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.582 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.582 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.582 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.582 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.582 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.582 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.582 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.582 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.582 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.629 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.629 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.630 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.630 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.630 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.630 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.630 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.630 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.630 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.630 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.630 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.630 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.646 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:31.646 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:31.646 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:31.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.646 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.646 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.646 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:31.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:31.646 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.646 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.647 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:31.647 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:31.661 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.661 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.662 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.662 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.662 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.662 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.662 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.662 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512931662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:31.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:31.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:15:31.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.780 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.780 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.781 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.781 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.781 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.781 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.781 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.781 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.781 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.781 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.796 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.796 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.797 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.797 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.797 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.797 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.797 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.797 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.797 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.797 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.797 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.797 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.797 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.811 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:31.811 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:31.812 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:31.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:31.812 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:31.812 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:31.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:31.812 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:31.812 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:31.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:31.812 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:31.812 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:31.812 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:31.833 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.833 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.833 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.833 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.833 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.834 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:31.901 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:31.901 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:31.901 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:31.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:31.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:31.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:31.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:31.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:31.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:31.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:31.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:31.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:31.902 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:31.909 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.909 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.909 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.909 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.909 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.910 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.910 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.910 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.910 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.910 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.910 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.913 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.913 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.913 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.914 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.914 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.914 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.914 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.914 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.936 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:31.936 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:31.936 [DEBUG - pool-266-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:31.936 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.936 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.937 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:31.937 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.937 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.936 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.937 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:31.937 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.937 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:31.937 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:31.938 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29531), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [7ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [12ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [22ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [23ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [60ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [242ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [281ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [282ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [282ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [282ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [383ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [383ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [383ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [384ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [782ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [783ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [783ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [783ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1523ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1524ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1524ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3562ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [6501ms] refreshing cache from master, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [6501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [6502ms] too many traces: truncated at 100 traces, deferred=Deferred@1819768651(state=PENDING, result=null, callback=(continuation of Deferred@1019917391 after retry RPC after error@700033376) -> (continuation of Deferred@1982148142 after retry RPC after error@566219406) -> (continuation of Deferred@1220436538 after retry RPC after error@740827364) -> (continuation of Deferred@1940078353 after retry RPC after error@752334921) -> (continuation of Deferred@390307931 after retry RPC after error@2055310679) -> (continuation of Deferred@280002209 after retry RPC after error@20220174) -> (continuation of Deferred@192917515 after retry RPC after error@2103602950) -> (continuation of Deferred@1848918909 after retry RPC after error@1273879372) -> (continuation of Deferred@1038403026 after retry RPC after error@1393596215) -> (continuation of Deferred@527636867 after retry RPC after error@979474074) -> (continuation of Deferred@556797521 after retry RPC after error@1984863343) -> (continuation of Deferred@1903569956 after retry RPC after error@1200988630) -> (continuation of Deferred@1727430131 after retry RPC after error@1683564710) -> (continuation of Deferred@604909317 after retry RPC after error@1325379907) -> (continuation of Deferred@464737418 after retry RPC after error@914506562) -> (continuation of Deferred@1663116432 after retry RPC after error@1348989982) -> (continuation of Deferred@1366420892 after retry RPC after error@1967991971) -> (continuation of Deferred@522359614 after retry RPC after error@1888109504) -> (continuation of Deferred@776555840 after retry RPC after error@855462942) -> (continuation of Deferred@969775644 after retry RPC after error@469453478) -> (continuation of Deferred@2143041492 after retry RPC after error@666489241) -> (continuation of Deferred@1928438280 after retry RPC after error@857630858) -> (continuation of Deferred@755166122 after retry RPC after error@1147064970) -> (continuation of Deferred@1002490347 after retry RPC after error@2077932577) -> (continuation of Deferred@1094666059 after retry RPC after error@1942423396), errback=(continuation of Deferred@1019917391 after retry RPC after error@700033376) -> (continuation of Deferred@1982148142 after retry RPC after error@566219406) -> (continuation of Deferred@1220436538 after retry RPC after error@740827364) -> (continuation of Deferred@1940078353 after retry RPC after error@752334921) -> (continuation of Deferred@390307931 after retry RPC after error@2055310679) -> (continuation of Deferred@280002209 after retry RPC after error@20220174) -> (continuation of Deferred@192917515 after retry RPC after error@2103602950) -> (continuation of Deferred@1848918909 after retry RPC after error@1273879372) -> (continuation of Deferred@1038403026 after retry RPC after error@1393596215) -> (continuation of Deferred@527636867 after retry RPC after error@979474074) -> (continuation of Deferred@556797521 after retry RPC after error@1984863343) -> (continuation of Deferred@1903569956 after retry RPC after error@1200988630) -> (continuation of Deferred@1727430131 after retry RPC after error@1683564710) -> (continuation of Deferred@604909317 after retry RPC after error@1325379907) -> (continuation of Deferred@464737418 after retry RPC after error@914506562) -> (continuation of Deferred@1663116432 after retry RPC after error@1348989982) -> (continuation of Deferred@1366420892 after retry RPC after error@1967991971) -> (continuation of Deferred@522359614 after retry RPC after error@1888109504) -> (continuation of Deferred@776555840 after retry RPC after error@855462942) -> (continuation of Deferred@969775644 after retry RPC after error@469453478) -> (continuation of Deferred@2143041492 after retry RPC after error@666489241) -> (continuation of Deferred@1928438280 after retry RPC after error@857630858) -> (continuation of Deferred@755166122 after retry RPC after error@1147064970) -> (continuation of Deferred@1002490347 after retry RPC after error@2077932577) -> (continuation of Deferred@1094666059 after retry RPC after error@1942423396)))
12:15:31.941 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:31.941 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:31.941 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:31.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.942 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.942 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:31.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.942 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.942 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:31.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:31.942 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:31.956 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:31.956 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:31.956 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:31.956 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:31.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:31.957 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:31.957 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:31.957 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:31.957 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:31.957 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:31.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:31.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:31.957 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:32.012 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:32.012 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:32.012 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:32.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:32.013 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:32.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:32.013 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:32.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:32.013 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:32.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:32.013 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:32.013 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:32.013 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:32.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.060 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:32.060 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:32.060 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:32.061 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.061 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.061 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.061 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.061 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.061 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.061 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.061 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.061 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:32.111 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.112 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.112 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.112 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.112 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.112 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.112 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.112 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.112 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.112 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.112 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.112 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.112 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:32.113 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:32.113 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:32.113 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:32.113 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.113 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.113 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.113 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.113 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.113 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.113 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.114 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:32.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512932162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:32.167 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.169 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:32.169 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:32.169 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.170 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:32.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.170 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.170 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.170 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.170 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.170 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:32.171 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:32.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:15:32.221 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:32.221 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:32.221 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:32.222 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:32.222 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:32.222 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:32.222 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:32.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:32.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:32.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:32.222 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:32.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:32.222 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:32.248 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:32.248 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:32.248 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:32.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.249 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.249 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.249 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.249 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.249 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:32.267 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:32.268 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:32.268 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:32.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.268 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.268 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.268 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.268 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.269 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:32.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.326 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.326 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.326 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.327 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:32.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.373 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:32.373 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:32.373 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:32.373 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.374 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:32.447 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:32.447 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:32.447 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:32.448 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.448 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.448 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.448 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.448 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:32.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.448 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:32.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:32.448 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:32.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:32Z chronyd exiting
12:15:32.465 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.465 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.465 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.465 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.465 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.466 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.466 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.466 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:32.469 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.470 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.470 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.470 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.19.5.124:34641(127.19.5.124:34641) for tablet Kudu Master: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.486 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.486 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.487 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.487 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.487 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.487 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.487 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.487 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.487 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.487 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.487 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.487 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:32.490 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.490 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.490 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.490 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.491 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.491 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.510 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.511 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.511 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.511 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.511 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.511 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.511 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.511 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.511 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.511 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.511 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.511 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.512 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.530 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.530 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.531 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.531 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.531 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.531 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.531 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.531 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.531 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.531 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.542 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:32.542 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:32.543 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:32.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.543 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.543 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.543 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.543 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.543 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.543 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.543 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:32.550 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.550 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.550 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.551 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.551 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.551 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.551 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.565 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.566 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.566 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.566 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.566 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.566 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.566 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.566 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.566 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.566 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.566 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:32.590 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.590 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.590 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.590 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.591 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.620 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:32.620 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:32.621 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:32.621 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.621 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.621 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.621 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:32.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.650 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.650 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.651 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512932662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:32.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.669 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:15:32.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:15:32.670 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.671 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.671 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.671 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.671 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.671 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.671 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:32.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:32.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:32.673 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.673 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.673 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.673 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.673 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.673 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.673 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.673 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.673 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.673 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:32.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:32.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:32.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:32.708 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.708 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.708 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.708 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.709 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:32.709 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:32.709 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.709 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.709 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:32.709 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:32.715 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:32.715 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:32.715 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:32.716 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.716 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.716 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.716 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.716 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:32.716 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:32.716 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.716 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.716 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:32.716 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:32.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.810 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:32.810 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:32.811 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.811 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:32.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.811 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:32.811 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.811 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:32.811 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.811 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.811 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:32.811 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:32.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:32.913 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:32.913 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:32.913 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.913 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.913 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:32.913 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:32.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:32.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:32.914 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:32.925 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:32.926 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:32.926 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:32.926 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.926 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.926 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:32.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:32.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:32.926 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:33.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.101 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:33.101 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:33.102 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:33.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:33.102 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:33.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:33.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:33.102 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:33.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:33.102 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:33.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:33.102 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:33.102 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:33.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512933162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:33.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.169 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:15:33.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
12:15:33.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.270 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:33.270 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:33.270 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:33.270 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.270 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.270 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.271 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.271 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.271 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.271 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.271 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.271 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.271 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:33.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.447 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:33.447 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:33.447 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:33.447 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.447 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.447 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.447 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.447 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.448 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.448 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.448 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.448 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.448 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:33.480 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:33.480 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:33.480 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:33.480 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.481 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.481 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.481 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.481 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.481 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.481 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.481 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.481 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.481 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
.12:15:33.496 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512933496
12:15:33.496 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512933496
12:15:33.501 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:15:33.505 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:15:33.505 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:15:33.506 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:15:33.506 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:15:33.506 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:15:33.510 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:15:33.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.546 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:33.546 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:33.547 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:33.547 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.547 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.547 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:33.547 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.547 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.547 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:33.547 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.547 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.547 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:33.548 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:33.648 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:33.648 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:33.649 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:33.649 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.649 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.649 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.649 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.649 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.649 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.650 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.650 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.650 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.650 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:33.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512933662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:33.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.671 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:33.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:15:33.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:33.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:33.708 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:33.708 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.709 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.709 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.709 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.709 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.709 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.709 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:33.753 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:33.753 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:33.753 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:33.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:33.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:33.754 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.754 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.754 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:33.754 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:33.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.821 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:33.821 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:33.821 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:33.821 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.821 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.821 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.821 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.821 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.821 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.821 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.822 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.822 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:33.851 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:33.851 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:15:33.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:33.854998 21650 mini_oidc.cc:150] Starting JWKS server
12:15:33.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:33.858206 21650 webserver.cc:533] Webserver started at http://127.0.0.1:39143/ using document root <none> and password file <none>
12:15:33.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:33.858630 21650 mini_oidc.cc:186] Starting OIDC Discovery server
12:15:33.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:33.860268 21650 webserver.cc:533] Webserver started at http://127.0.0.1:37581/ using document root <none> and password file <none>
12:15:33.867 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:33.868 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:33.868 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:33.868 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.868 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.868 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:33.868 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.868 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:33.869 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.869 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.869 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:33.869 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:33.870 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:33.870 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:33.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:33.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.870 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.870 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:33.870 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:33.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:33.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:33.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:33Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:15:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:33Z Disabled control of system clock
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:33.919708 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/logs
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data/info.pb
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.190:33455
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.190
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json with env {}
12:15:34.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.028 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:34.028 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:34.029 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:34.029 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.029 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.029 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.029 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.029 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.029 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.029 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:34.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:34.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:34.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:34.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.052 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.052 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.052 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.052 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.052 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.052 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.052 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:34.145 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:34.146 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:34.146 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:34.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.146 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:34.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512934161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:34.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.172 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:34.172 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:34.172 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:34.172 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:34.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:34.173 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:34.173 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:34.173 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:34.173 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:34.173 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:34.173 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:34.173 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:34.173 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:34.174 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:15:34.174 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:15:34.176 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:34.177 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:34.177 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:34.177 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:34.177 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:34.177 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:34.177 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:34.177 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:34.177 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:34.177 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:34.177 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:34.177 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:34.177 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:34.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.227519 21662 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:34.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.228073 21662 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:34.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.228570 21662 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.261197 21662 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.261483 21662 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.261747 21662 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.261955 21662 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.262154 21662 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.262302 21662 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39143/jwks.json
12:15:34.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:34.299633 21662 master_runner.cc:387] Master server non-default flags:
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.190:33455
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data/info.pb
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.190
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/logs
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:34.300979 21662 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:34.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:34.302620 21662 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.313548 21668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:34.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.411 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:34.412 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:34.412 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:34.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.413 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.413 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.413 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.413 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.413 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.413 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.413 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.413 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.414 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:34.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.527 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:34.528 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:34.528 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:34.528 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:34.529 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:34.529 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:34.529 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:34.529 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:34.529 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:34.529 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:34.529 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:34.529 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:34.530 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:34.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512934662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:34.669 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.675 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:15:34.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:15:34.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.786 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:34.786 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:34.787 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:34.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:34.788 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.788 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.788 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:34.788 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.788 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.788 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:34.788 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:34.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:34.872 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:34.873 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:34.873 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:34.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.874 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:34.941 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:34.941 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:34.941 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:34.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.942 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.942 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:34.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:34.942 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.942 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.942 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:34.943 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:35.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.030 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:35.030 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:35.031 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:35.031 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:35.031 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:35.031 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:35.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:35.031 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:35.031 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:35.031 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:35.031 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:35.031 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:35.031 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:35.112 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:35.112 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:35.113 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:35.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:35.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:35.113 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:35.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:35.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:35.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:35.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:35.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:35.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:35.114 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:35.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512935162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:35.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.174 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:15:35.175 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:15:35.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.381 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:35.381 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:35.382 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:35.382 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:35.382 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:35.382 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:35.383 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:35.383 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:35.383 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:35.383 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:35.383 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:35.383 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:35.383 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:35.431 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:35.432 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:35.432 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:35.433 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.433 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.433 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.433 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.433 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.434 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:35.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.563 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:35.563 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:35.563 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:35.564 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.564 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.564 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.564 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.564 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.564 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.565 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.565 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.565 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.565 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:35.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512935662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:35.668 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.673 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:15:35.675 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:15:35.759 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:35.760 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:35.760 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:35.761 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.761 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.761 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:35.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.761 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:35.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:35.762 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:35.767 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:35.767 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:35.767 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:35.768 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:35.768 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:35.768 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:35.768 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:35.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:35.768 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:35.768 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:35.768 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:35.769 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:35.769 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:35.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:35.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:35.717332 21667 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 21662
12:15:35.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:35.872463 21662 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.558s	user 0.657s	sys 0.898s
12:15:35.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:35.874490 21671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:35.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:35.874712 21662 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.561s	user 0.657s	sys 0.898s
12:15:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:35.873934 21670 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1559 milliseconds
12:15:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:34.314867 21669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.875454 21662 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:35.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.880309 21662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.883394 21662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:35.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.884923 21662 hybrid_clock.cc:648] HybridClock initialized: now 1783512935884847 us; error 74 us; skew 500 ppm
12:15:35.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.886093 21662 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:35.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.893718 21662 webserver.cc:533] Webserver started at http://127.21.36.190:37173/ using document root <none> and password file <none>
12:15:35.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.894991 21662 fs_manager.cc:362] Metadata directory not provided
12:15:35.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.895267 21662 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:35.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.895852 21662 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:35.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.902302 21662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data/instance:
12:15:35.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f49cece95a6046fb85ef57deede1bd3b"
12:15:35.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:35 on dist-test-slave-vcgh"
12:15:35.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.903882 21662 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal/instance:
12:15:35.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f49cece95a6046fb85ef57deede1bd3b"
12:15:35.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:35 on dist-test-slave-vcgh"
12:15:35.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.912341 21662 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.007s
12:15:35.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.918535 21678 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:35.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.919673 21662 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.919945 21662 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f49cece95a6046fb85ef57deede1bd3b"
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:35 on dist-test-slave-vcgh"
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.920285 21662 fs_report.cc:389] FS layout report
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data/data
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:35.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:35.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:35.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:35.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:35.945 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:35.946 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:35.946 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:35.946 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.946 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.946 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:35.947 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.947 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:35.946 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:35.947 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:35.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.982314 21662 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:35.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.983927 21662 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:35.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:35.984400 21662 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:36.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.073415 21662 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.190:33455
12:15:36.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.073523 21729 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.190:33455 every 8 connection(s)
12:15:36.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.076251 21662 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/data/info.pb
12:15:36.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.082913 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:36.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.087184 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 21662
12:15:36.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.087685 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-0/wal/instance
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.092613 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/logs
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data/info.pb
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.189:35221
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.189
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:36.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json with env {}
12:15:36.093 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:36.094 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:36.094 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:36.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.094 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.095 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.095 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.095 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.095 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.095 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.095 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.095 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:36.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.097209 21730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
12:15:36.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.132020 21730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } has no permanent_uuid. Determining permanent_uuid...
12:15:36.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.134399 21680 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.138728 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512936162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:36.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.169 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:15:36.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:15:36.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.188220 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 1
12:15:36.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.193051 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.261457 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 2
12:15:36.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.265702 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.279 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:36.280 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:36.280 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:36.280 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.280 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.280 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.280 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:36.280 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.280 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.280 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.280 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:36.280 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:36.280 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:36.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.357100 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 3
12:15:36.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.361677 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:36.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:36.413 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:36.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:36.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:36.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:36.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:36.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:36.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:36.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:36.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:36.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:36.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.420944 21732 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.421505 21732 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:36.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.421993 21732 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:36.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.454946 21732 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:36.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.455228 21732 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:36.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.455471 21732 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:36.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.455701 21732 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:36.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.455897 21732 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:36.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.456048 21732 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39143/jwks.json
12:15:36.467 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:36.467 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:36.467 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:36.468 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:36.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:36.468 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:36.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:36.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:36.468 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:36.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:36.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:36.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:36.468 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.495179 21732 master_runner.cc:387] Master server non-default flags:
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.189:35221
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data/info.pb
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.189
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/logs
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:36.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:36.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.496470 21732 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:36.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.498031 21732 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:36.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.505087 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 4
12:15:36.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.509490 21741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:36.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.511132 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.527 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:36.527 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:36.528 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:36.528 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.528 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.528 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.528 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.528 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.528 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.528 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.528 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.528 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.528 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:36.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512936662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:36.665 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:36.665 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:36.666 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:36.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.667 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.668 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.668 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.668 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:36.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:36.669 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:36.669 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:36.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:36.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:36.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.670 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:36.670 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:36.670 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:36.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:15:36.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:36.791 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:36.791 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:36.791 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:36.792 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.792 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.792 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.792 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.792 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.792 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.792 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:36.792 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:36.792 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:36.792 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:36.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.810557 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 5
12:15:36.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.815140 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:36.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:36.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:36.831 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:36.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:36.831 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:36.831 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:36.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:36.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:36.831 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:36.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:36.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:36.831 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:36.831 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:36.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.126 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:37.126 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:37.127 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:37.127 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.127 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.127 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.127 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.127 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.127 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.127 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:37.149 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:37.149 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:37.149 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:37.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:37.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:37.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:37.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:37.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:37.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:37.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:37.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:37.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:37.152 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:37.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512937162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:37.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.172 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:37.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:15:37.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.294 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:37.294 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:37.294 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:37.294 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.295 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.295 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.295 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.295 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.295 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.295 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.295 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:37.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.362528 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 6
12:15:37.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:37.379570 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.189:35221: Network error: Client connection negotiation failed: client connection to 127.21.36.189:35221: connect: Connection refused (error 111)
12:15:37.401 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:37.402 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:37.402 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:37.402 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.402 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.402 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.402 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.403 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.403 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:37.407 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:37.408 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:37.408 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:37.408 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:37.408 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:37.408 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:37.408 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:37.408 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:37.408 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:37.408 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:37.408 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:37.408 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:37.409 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:37.426 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:37.426 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:37.426 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:37.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:37.426 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.426 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.426 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:37.427 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.427 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.427 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:37.427 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:37.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.541 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:37.542 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:37.542 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:37.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:37.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:37.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:37.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:37.542 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:37.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:37.542 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:37.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:37.542 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:37.542 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:37.596 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:37.596 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:37.596 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:37.596 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.596 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.596 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.596 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.596 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.596 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.597 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:37.603 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:37.603 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:37.603 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:37.603 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.603 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:37.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:37.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:37.604 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:37.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.512434 21742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:37.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:36.514868 21744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:37.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:36.514078 21732 server_base.cc:1061] running on GCE node
12:15:37.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.645622 21732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:37.648 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:37.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.648509 21732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:37.648 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:37.649 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:37.649 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.649 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.649 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.649 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:37.649 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.649 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:37.649 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.649 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.649 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:37.649 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:37.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.649919 21732 hybrid_clock.cc:648] HybridClock initialized: now 1783512937649833 us; error 100 us; skew 500 ppm
12:15:37.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.650698 21732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:37.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.656915 21732 webserver.cc:533] Webserver started at http://127.21.36.189:39141/ using document root <none> and password file <none>
12:15:37.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.657761 21732 fs_manager.cc:362] Metadata directory not provided
12:15:37.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.657939 21732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:37.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.658314 21732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:37.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.662513 21732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data/instance:
12:15:37.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "743f6fde25fd43fb88a7a42ffeebdaa2"
12:15:37.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:37 on dist-test-slave-vcgh"
12:15:37.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512937662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:37.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.663694 21732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal/instance:
12:15:37.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "743f6fde25fd43fb88a7a42ffeebdaa2"
12:15:37.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:37 on dist-test-slave-vcgh"
12:15:37.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.670 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:15:37.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:15:37.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.672618 21732 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
12:15:37.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.678227 21753 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:37.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.679327 21732 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
12:15:37.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.679615 21732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal
12:15:37.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "743f6fde25fd43fb88a7a42ffeebdaa2"
12:15:37.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:37 on dist-test-slave-vcgh"
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.679937 21732 fs_report.cc:389] FS layout report
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data/data
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:37.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:37.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.726042 21732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:37.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.727473 21732 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:37.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.727905 21732 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:37.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.800323 21732 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.189:35221
12:15:37.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.800422 21804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.189:35221 every 8 connection(s)
12:15:37.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.803113 21732 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/data/info.pb
12:15:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.807684 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 21732
12:15:37.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.808164 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-1/wal/instance
12:15:37.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.809988 21805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.811054 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/logs
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data/info.pb
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.188:41809
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.188
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:37.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json with env {}
12:15:37.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.822355 21805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
12:15:37.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.852769 21805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } has no permanent_uuid. Determining permanent_uuid...
12:15:37.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:37.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.867452 21805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
12:15:37.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:37.869918 21755 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:37.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:37.874217 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:37.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.923679 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 1
12:15:37.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:37.928373 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:37.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:37.996783 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 2
12:15:38.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.000998 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.092473 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 3
12:15:38.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.096645 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.123723 21807 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:38.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.124297 21807 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:38.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.124804 21807 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:38.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.158376 21807 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:38.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.158684 21807 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:38.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.158937 21807 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:38.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.159148 21807 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:38.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.159343 21807 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:38.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.159487 21807 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:39143/jwks.json
12:15:38.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512938162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:38.169 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.174 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:15:38.174 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.200148 21807 master_runner.cc:387] Master server non-default flags:
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.188:41809
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:38.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39143/jwks.json
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data/info.pb
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.188
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/logs
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:38.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.201540 21807 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:38.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.203325 21807 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:38.212 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:38.212 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:38.212 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:38.213 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:38.213 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:38.213 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:38.213 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:38.213 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:38.213 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:38.213 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:38.213 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:38.214 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:38.214 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:38.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.219750 21817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:38.229 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:38.229 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:38.229 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:38.230 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.230 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.230 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:38.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.240110 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 4
12:15:38.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.246039 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.286 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:38.286 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:38.287 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:38.287 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.287 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.287 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.288 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:38.353 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:38.353 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:38.353 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:38.354 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.354 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.354 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.354 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.354 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.354 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.354 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:38.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.440044 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } attempt: 7
12:15:38.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:38.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:38.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:38.453 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.453 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.453 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.454 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.454 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.454 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:38.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.467845 21730 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
12:15:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.474779 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.506 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:38.506 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:38.507 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:38.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.507 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.507 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.507 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.507 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.507 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.507 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.507 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.507 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.507 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:38.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.533239 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 1
12:15:38.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.538765 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.545535 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 5
12:15:38.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.550997 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.559 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:38.560 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:38.560 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:38.560 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:38.560 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:38.560 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:38.560 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:38.560 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:38.560 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:38.560 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:38.560 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:38.560 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:38.561 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:38.620 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:38.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.620249 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 2
12:15:38.621 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:38.621 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:38.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.621 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.621 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.621 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.621 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.622 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:38.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.625665 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.640 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:38.641 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:38.641 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:38.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.641 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.641 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.641 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.641 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.641 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.641 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.641 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.641 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:38.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512938661 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:38.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:38.668 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:38.668 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:38.669 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:38.669 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:38.669 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:38.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:38.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:38.669 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:38.669 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:38.669 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:38.669 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:38.669 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:38.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:38.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:15:38.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.711074 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 3
12:15:38.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.716166 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.832 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:38.832 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:38.833 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:38.833 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.833 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:38.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:38.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:38.833 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:38.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:38.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.856559 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 4
12:15:38.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.861109 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:38.861 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:38.861 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:38.861 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:38.861 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.862 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.862 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:38.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:38.862 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.862 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.862 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:38.862 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:38.907 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:38.907 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:38.907 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:38.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.907 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.907 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.908 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:38.908 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:38.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.908 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:38.908 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:39.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:39.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:39.031 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:39.032 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.032 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.032 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.032 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.032 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.032 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.032 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:39.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.098446 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 6
12:15:39.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.105659 21805 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:39.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.144469 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 5
12:15:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.148761 21730 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.36.188:41809: Network error: Client connection negotiation failed: client connection to 127.21.36.188:41809: connect: Connection refused (error 111)
12:15:39.150 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:39.150 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:39.150 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:39.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:39.150 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:39.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:39.150 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:39.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:39.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:39.151 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:39.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:39.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:39.151 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:39.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512939162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:39.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.173 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:39.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:15:39.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.287 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:39.288 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:39.288 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:39.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:39.288 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:39.288 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:39.288 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:39.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:39.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:39.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:39.288 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:39.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:39.289 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:39.325 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:39.325 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:39.326 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:39.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.326 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.326 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.326 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.326 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.326 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:39.332 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:39.332 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:39.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:39.333 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.333 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.333 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.333 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.333 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:39.353 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.219751 21818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:38.221966 21820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:39.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:38.222131 21807 server_base.cc:1061] running on GCE node
12:15:39.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.372641 21807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:39.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.375283 21807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:39.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.376663 21807 hybrid_clock.cc:648] HybridClock initialized: now 1783512939376634 us; error 40 us; skew 500 ppm
12:15:39.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.377533 21807 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:39.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.383523 21807 webserver.cc:533] Webserver started at http://127.21.36.188:42893/ using document root <none> and password file <none>
12:15:39.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.384435 21807 fs_manager.cc:362] Metadata directory not provided
12:15:39.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.384642 21807 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:39.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.385144 21807 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:39.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.389638 21807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data/instance:
12:15:39.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b50fd0227aa04317b0272a33203386ee"
12:15:39.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:39 on dist-test-slave-vcgh"
12:15:39.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.390733 21807 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal/instance:
12:15:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b50fd0227aa04317b0272a33203386ee"
12:15:39.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:39 on dist-test-slave-vcgh"
12:15:39.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.398016 21807 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
12:15:39.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.403566 21833 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:39.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.404650 21807 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.404953 21807 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b50fd0227aa04317b0272a33203386ee"
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:39 on dist-test-slave-vcgh"
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.405256 21807 fs_report.cc:389] FS layout report
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data/data
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:39.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:39.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:39.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:39.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.469053 21807 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:39.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.470489 21807 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:39.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.470913 21807 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:39.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.544329 21807 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.188:41809
12:15:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.544452 21884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.188:41809 every 8 connection(s)
12:15:39.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.547086 21807 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/data/info.pb
12:15:39.551 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:39.551 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:39.551 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:39.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.552 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.552 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.552 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:39.552 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:39.552 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.552 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.552 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:39.552 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:39.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.553368 21885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:39.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.553694 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 21807
12:15:39.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.554052 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/master-2/wal/instance
12:15:39.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.567994 21885 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } has no permanent_uuid. Determining permanent_uuid...
12:15:39.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.591001 21885 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } has no permanent_uuid. Determining permanent_uuid...
12:15:39.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.601543 21885 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } has no permanent_uuid. Determining permanent_uuid...
12:15:39.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.617667 21885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: Bootstrap starting.
12:15:39.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.624275 21885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: Neither blocks nor log segments found. Creating new log.
12:15:39.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.626608 21885 log.cc:826] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: Log is configured to *not* fsync() on all Append() calls
12:15:39.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.631278 21885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: No bootstrap required, opened a new log
12:15:39.641 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:39.641 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:39.641 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:39.641 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:39.641 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:39.641 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:39.641 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:39.641 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:39.641 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:39.641 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:39.641 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:39.642 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:39.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:39.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.650626 21885 raft_consensus.cc:359] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.651260 21885 raft_consensus.cc:385] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:39.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.651499 21885 raft_consensus.cc:740] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b50fd0227aa04317b0272a33203386ee, State: Initialized, Role: FOLLOWER
12:15:39.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.652217 21885 consensus_queue.cc:260] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.654910 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:39.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.655925 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: This master's current role is: FOLLOWER
12:15:39.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.656493 21885 sys_catalog.cc:565] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: configured and running, proceeding with master startup.
12:15:39.665 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512939662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:39.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.674 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:15:39.675 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:15:39.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.684548 21905 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:39.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.684888 21905 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:39.700 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:39.700 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:39.700 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:39.701 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.701 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.701 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.701 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:39.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.701172 21730 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 6
12:15:39.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.705 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:39.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.705 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:39.705 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:39.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.682571 21807 master_runner.cc:187] Error getting master registration for 127.21.36.190:33455: OK, instance_id { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" instance_seqno: 1783512936045033 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:39.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.714870 21807 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:39.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.725805 21730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: Bootstrap starting.
12:15:39.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.726049 21839 tablet.cc:2406] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:39.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.733464 21730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: Neither blocks nor log segments found. Creating new log.
12:15:39.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.735737 21730 log.cc:826] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: Log is configured to *not* fsync() on all Append() calls
12:15:39.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.740634 21730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: No bootstrap required, opened a new log
12:15:39.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.767988 21730 raft_consensus.cc:359] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.768872 21730 raft_consensus.cc:385] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:39.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.769351 21730 raft_consensus.cc:740] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49cece95a6046fb85ef57deede1bd3b, State: Initialized, Role: FOLLOWER
12:15:39.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.770303 21730 consensus_queue.cc:260] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.773054 21909 sys_catalog.cc:455] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:39.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.773775 21909 sys_catalog.cc:458] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: This master's current role is: FOLLOWER
12:15:39.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.774945 21730 sys_catalog.cc:565] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: configured and running, proceeding with master startup.
12:15:39.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.805958 21909 raft_consensus.cc:493] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:39.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.806573 21909 raft_consensus.cc:515] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.814404 21909 leader_election.cc:290] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 743f6fde25fd43fb88a7a42ffeebdaa2 (127.21.36.189:35221), b50fd0227aa04317b0272a33203386ee (127.21.36.188:41809)
12:15:39.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.816390 21860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f49cece95a6046fb85ef57deede1bd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b50fd0227aa04317b0272a33203386ee" is_pre_election: true
12:15:39.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.817795 21860 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49cece95a6046fb85ef57deede1bd3b in term 0.
12:15:39.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.819329 21680 leader_election.cc:304] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b50fd0227aa04317b0272a33203386ee, f49cece95a6046fb85ef57deede1bd3b; no voters: 
12:15:39.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.821667 21909 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:39.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.822300 21909 raft_consensus.cc:493] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:39.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.822755 21909 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 0 FOLLOWER]: Advancing to term 1
12:15:39.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.826251 21920 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:39.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.828200 21920 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:39.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.830603 21909 raft_consensus.cc:515] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.835984 21860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f49cece95a6046fb85ef57deede1bd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b50fd0227aa04317b0272a33203386ee"
12:15:39.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.836567 21860 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 0 FOLLOWER]: Advancing to term 1
12:15:39.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.849293 21860 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49cece95a6046fb85ef57deede1bd3b in term 1.
12:15:39.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:39.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.858512 21680 leader_election.cc:304] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b50fd0227aa04317b0272a33203386ee, f49cece95a6046fb85ef57deede1bd3b; no voters: 
12:15:39.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.861353 21909 leader_election.cc:290] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [CANDIDATE]: Term 1 election: Requested vote from peers 743f6fde25fd43fb88a7a42ffeebdaa2 (127.21.36.189:35221), b50fd0227aa04317b0272a33203386ee (127.21.36.188:41809)
12:15:39.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.862625 21922 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 1 FOLLOWER]: Leader election won for term 1
12:15:39.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.863583 21922 raft_consensus.cc:697] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [term 1 LEADER]: Becoming Leader. State: Replica: f49cece95a6046fb85ef57deede1bd3b, State: Running, Role: LEADER
12:15:39.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.865267 21922 consensus_queue.cc:237] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:39.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.811291 21662 master_runner.cc:187] Error getting master registration for 127.21.36.189:35221: OK, instance_id { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" instance_seqno: 1783512937780099 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:39.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.872637 21662 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:39.883 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:39.883 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:39.883 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:39.883 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:39.884 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:39.884 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:39.884 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:39.884 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:39.884 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:39.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:39.889 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:39.889 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:39.889 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:39.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.891480 21909 sys_catalog.cc:455] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f49cece95a6046fb85ef57deede1bd3b. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:39.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.892467 21909 sys_catalog.cc:458] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: This master's current role is: LEADER
12:15:39.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.896497 21924 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:15:39.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.916597 21924 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:15:39.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.959437 21860 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [term 1 FOLLOWER]: Refusing update from remote peer f49cece95a6046fb85ef57deede1bd3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:39.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:39.961321 21922 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:39.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:39.994293 21684 tablet.cc:2406] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:40.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.015811 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader f49cece95a6046fb85ef57deede1bd3b. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.016495 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: This master's current role is: FOLLOWER
12:15:40.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:40.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:40.021 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:40.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:40.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:40.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:40.022 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:40.022 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:40.023 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:40.023 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:40.023 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:40.023 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:40.023 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:40.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.025946 21925 mvcc.cc:204] Tried to move back new op lower bound from 7305269002046779392 to 7305269001705611264. Current Snapshot: MvccSnapshot[applied={T|T < 7305269002046779392}]
12:15:40.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.030614 21909 sys_catalog.cc:455] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.031327 21909 sys_catalog.cc:458] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: This master's current role is: LEADER
12:15:40.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.042521 21894 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.043203 21894 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee [sys.catalog]: This master's current role is: FOLLOWER
12:15:40.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.046645 21924 catalog_manager.cc:1383] Generated new cluster ID: 572fd445b9904bcd959cbcdd444a371c
12:15:40.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.046952 21924 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:15:40.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:40.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:40.086 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:40.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.087 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.087 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.087 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.087 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.087 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.087 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.087 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:40.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.136119 21924 catalog_manager.cc:1406] Generated new certificate authority record
12:15:40.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.143059 21924 catalog_manager.cc:1540] Loading token signing keys...
12:15:40.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512940162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:40.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.169451 21805 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } attempt: 7
12:15:40.184 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=21 ms, finalizationTime=1 ms).
12:15:40.185 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:15:40.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.195140 21924 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b: Generated new TSK 0
12:15:40.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.198707 21924 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:15:40.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.226078 21805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: Bootstrap starting.
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.239746 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/logs
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data/info.pb
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.129:0
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.129
12:15:40.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.129
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:40.247 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:40.247 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:40.247 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:40.248 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:40.248 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:40.248 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:40.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:40.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:40.248 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:40.249 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:40.249 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:40.249 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:40.249 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:40.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.253875 21805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: Neither blocks nor log segments found. Creating new log.
12:15:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.258347 21805 log.cc:826] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: Log is configured to *not* fsync() on all Append() calls
12:15:40.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.272034 21805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: No bootstrap required, opened a new log
12:15:40.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.300076 21805 raft_consensus.cc:359] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:40.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.300923 21805 raft_consensus.cc:385] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:40.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.301206 21805 raft_consensus.cc:740] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 743f6fde25fd43fb88a7a42ffeebdaa2, State: Initialized, Role: FOLLOWER
12:15:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.302201 21805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } }
12:15:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.312983 21805 sys_catalog.cc:565] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: configured and running, proceeding with master startup.
12:15:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.313162 21780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f49cece95a6046fb85ef57deede1bd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" is_pre_election: true
12:15:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.314117 21780 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49cece95a6046fb85ef57deede1bd3b in term 0.
12:15:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.315210 21779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f49cece95a6046fb85ef57deede1bd3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2"
12:15:40.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.316184 21933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.316982 21933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: This master's current role is: FOLLOWER
12:15:40.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.318136 21779 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 0 FOLLOWER]: Advancing to term 1
12:15:40.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.325819 21779 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49cece95a6046fb85ef57deede1bd3b in term 1.
12:15:40.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.339890 21778 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [term 1 FOLLOWER]: Refusing update from remote peer f49cece95a6046fb85ef57deede1bd3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:40.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.343847 21922 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:40.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.416085 21933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f49cece95a6046fb85ef57deede1bd3b. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.416108 21946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.417017 21933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: This master's current role is: FOLLOWER
12:15:40.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.417546 21946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2 [sys.catalog]: This master's current role is: FOLLOWER
12:15:40.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.425598 21949 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:15:40.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.549 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:40.549 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:40.549 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:40.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:40.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:40.549 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:40.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:40.549 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:40.549 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:40.550 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:40.550 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:40.550 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:40.550 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:40.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512940662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:40.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.675 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:15:40.677 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:15:40.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.690932 21905 catalog_manager.cc:1295] Loaded cluster ID: 572fd445b9904bcd959cbcdd444a371c
12:15:40.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.691201 21905 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: loading cluster ID for follower catalog manager: success
12:15:40.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.700371 21905 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: acquiring CA information for follower catalog manager: success
12:15:40.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.715610 21905 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b50fd0227aa04317b0272a33203386ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:40.772 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.826 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:40.826 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:40.826 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:40.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.827 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.827 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:40.827 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.827 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.827 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:40.827 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.828 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.828 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:40.828 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.849642 21950 sys_catalog.cc:455] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f49cece95a6046fb85ef57deede1bd3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49cece95a6046fb85ef57deede1bd3b" member_type: VOTER last_known_addr { host: "127.21.36.190" port: 33455 } } peers { permanent_uuid: "743f6fde25fd43fb88a7a42ffeebdaa2" member_type: VOTER last_known_addr { host: "127.21.36.189" port: 35221 } } peers { permanent_uuid: "b50fd0227aa04317b0272a33203386ee" member_type: VOTER last_known_addr { host: "127.21.36.188" port: 41809 } } }
12:15:40.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:40.850378 21950 sys_catalog.cc:458] T 00000000000000000000000000000000 P f49cece95a6046fb85ef57deede1bd3b [sys.catalog]: This master's current role is: LEADER
12:15:40.854 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:40.916 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:40.916 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:40.916 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:40.917 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:40.917 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:40.917 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:40.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:40.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:40.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:40.918 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:40.918 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:40.918 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:40.919 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:40.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:40.967865 21931 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:40.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:40.968519 21931 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:40.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:40.969252 21931 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:40.999 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:41.000 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:41.000 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:41.000 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.000 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.001 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.001 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.001 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:41.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:41.026723 21931 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:41.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:41.028056 21931 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.129
12:15:41.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.089401 21931 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:41.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.129:0
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data/info.pb
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.129
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.129
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/logs
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:41.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.091099 21931 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:41.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.093237 21931 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:41.113 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:41.114 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:41.114 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:41.114 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.114 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.114 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.114 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.114 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.115 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.115 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.115 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:41.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:41.130625 21958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:41.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512941162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:41.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.173 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:15:41.175 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:15:41.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:41.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:41.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:41.193 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.194 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.194 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.194 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.194 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.194 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.194 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.194 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.194 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.194 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:41.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.354 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.456928 21949 catalog_manager.cc:1295] Loaded cluster ID: 572fd445b9904bcd959cbcdd444a371c
12:15:41.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.457240 21949 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: loading cluster ID for follower catalog manager: success
12:15:41.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.472604 21949 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: acquiring CA information for follower catalog manager: success
12:15:41.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:41.494344 21949 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 743f6fde25fd43fb88a7a42ffeebdaa2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:41.505 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:41.505 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:41.505 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:41.506 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.506 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.506 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.506 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.506 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.506 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.506 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:41.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.580 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:41.580 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:41.580 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:41.581 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.581 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.581 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.581 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.581 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.581 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.581 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.581 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.581 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.581 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:41.661 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:41.661 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:41.661 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:41.661 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:41.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:41.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:41.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:41.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:41.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:41.664 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:41.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:41.664 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:41.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.665 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512941664 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:41.666 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:41.675 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:41.676 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:15:41.726 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:41.727 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:41.727 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:41.727 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.727 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.727 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:41.727 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.727 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.727 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:41.727 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.728 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:41.728 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:41.741 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:41.741 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:41.741 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:41.741 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.741 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.741 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:41.742 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.742 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.742 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:41.742 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.742 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.742 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:41.742 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:41.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:41.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:41.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:41.830 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:41.830 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:41.831 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:41.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:41.833 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:41.833 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:41.833 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:41.833 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:41.833 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:41.833 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:41.853 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:41.907 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:41.907 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:41.907 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:41.908 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:41.908 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:41.908 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:41.908 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:41.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:41.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:41.909 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:41.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:41.909 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:41.909 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:41.971 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:41.972 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:41.972 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:41.972 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.973 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.981 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:41.982 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [30ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [115ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [386ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [386ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [784ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [788ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2221ms] refreshing cache from master, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [5920ms] refreshing cache from master, [5920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5921ms] too many traces: truncated at 100 traces, deferred=Deferred@2038512755(state=PENDING, result=null, callback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895), errback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895)))
12:15:41.982 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:41.982 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:41.982 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:41.983 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:41.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.983 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:41.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.983 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:41.983 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [30ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [115ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [386ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [386ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [784ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [788ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2221ms] refreshing cache from master, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [5920ms] refreshing cache from master, [5920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5921ms] too many traces: truncated at 100 traces, deferred=Deferred@2038512755(state=PENDING, result=null, callback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895), errback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [30ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [115ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [386ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [386ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [784ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [788ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2221ms] refreshing cache from master, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [5920ms] refreshing cache from master, [5920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5921ms] too many traces: truncated at 100 traces, deferred=Deferred@2038512755(state=PENDING, result=null, callback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895), errback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.60:33275
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:41.985 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.985 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.985 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:41.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:41.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.986 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.986 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:41.986 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:41.983 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.987 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:41.988 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [30ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [115ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [386ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [386ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [784ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [788ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2221ms] refreshing cache from master, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [5920ms] refreshing cache from master, [5920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5921ms] too many traces: truncated at 100 traces, deferred=Deferred@2038512755(state=PENDING, result=null, callback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895), errback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=26824), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [27ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [30ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [79ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [87ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [87ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [115ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [386ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [386ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [782ms] refreshing cache from master, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [784ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [788ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [788ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2221ms] refreshing cache from master, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [5920ms] refreshing cache from master, [5920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5921ms] too many traces: truncated at 100 traces, deferred=Deferred@2038512755(state=PENDING, result=null, callback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895), errback=(continuation of Deferred@659967992 after retry RPC after error@708476071) -> (continuation of Deferred@790636002 after retry RPC after error@1605560017) -> (continuation of Deferred@1250843472 after retry RPC after error@866703842) -> (continuation of Deferred@495576384 after retry RPC after error@1430588494) -> (continuation of Deferred@1839827309 after retry RPC after error@414923507) -> (continuation of Deferred@1246392129 after retry RPC after error@923807034) -> (continuation of Deferred@374552660 after retry RPC after error@1467937999) -> (continuation of Deferred@1322756358 after retry RPC after error@2023240731) -> (continuation of Deferred@2005279428 after retry RPC after error@1476294775) -> (continuation of Deferred@605185047 after retry RPC after error@487826530) -> (continuation of Deferred@1539646726 after retry RPC after error@2145174473) -> (continuation of Deferred@1222193913 after retry RPC after error@1223274292) -> (continuation of Deferred@989220410 after retry RPC after error@590151718) -> (continuation of Deferred@576892992 after retry RPC after error@662121271) -> (continuation of Deferred@796403325 after retry RPC after error@1679769476) -> (continuation of Deferred@1405641719 after retry RPC after error@1308152874) -> (continuation of Deferred@593319974 after retry RPC after error@1042526422) -> (continuation of Deferred@786742078 after retry RPC after error@624321356) -> (continuation of Deferred@1826849700 after retry RPC after error@1332034542) -> (continuation of Deferred@1146311799 after retry RPC after error@1382638514) -> (continuation of Deferred@577185016 after retry RPC after error@1144770833) -> (continuation of Deferred@446027021 after retry RPC after error@58212638) -> (continuation of Deferred@405005677 after retry RPC after error@42601505) -> (continuation of Deferred@914590912 after retry RPC after error@1999784895)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.60:33275
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:41.989 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:41.989 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:15:41.989 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
12:15:41.989 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
12:15:41.990 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:41.990 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
12:15:41.990 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:41.990 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
12:15:41.990 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
12:15:41.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
12:15:41.991 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
12:15:41.991 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
12:15:41.991 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:41.991 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
12:15:41.991 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:41.991 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:41.991 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.992 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.992 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:41.992 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.992 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.992 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:41.992 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.992 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.992 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:41.992 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:41.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:41.998 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
12:15:41.999 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:42.002 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
12:15:42.002 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to CANCELING.
12:15:42.003 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
12:15:42.007 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:42.008 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
12:15:42.008 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
12:15:42.011 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.012 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.012 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.012 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.012 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.012 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.013 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.013 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.013 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.013 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.013 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.013 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.013 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.019 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
12:15:42.019 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to CANCELING.
12:15:42.019 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
12:15:42.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.026 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:42.026 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
12:15:42.026 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
12:15:42.031 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.031 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.031 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.032 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.033 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.033 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.033 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.033 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
12:15:42.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to CANCELING.
12:15:42.036 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
12:15:42.039 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:42.039 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
12:15:42.039 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
12:15:42.049 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
12:15:42.049 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
12:15:42.050 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
12:15:42.050 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
12:15:42.050 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
12:15:42.051 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:42.051 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CANCELING to CANCELED.
12:15:42.052 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:42.052 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.052 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CANCELING to CANCELED.
12:15:42.052 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.052 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.052 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:42.052 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CANCELING to CANCELED.
12:15:42.052 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.052 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.052 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.053 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.053 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.053 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.053 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:15:42.053 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.053 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.053 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.053 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.071 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.071 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.072 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.072 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.072 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.072 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.072 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.073 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.073 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.073 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.073 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.073 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.073 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.151 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.151 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.151 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.152 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.152 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.152 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.152 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.152 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.153 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.153 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.153 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.153 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.153 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512942161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:42.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.171 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:42.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:15:42.232 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.232 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.232 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.233 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.233 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.233 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.233 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.233 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.233 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.233 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.233 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.233 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.265 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:42.266 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:42.266 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:42.266 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.266 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.266 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.267 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.267 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.267 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.267 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.267 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.267 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:42.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:42.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:42.280 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:42.281 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.281 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.281 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.281 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.281 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.281 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.282 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.282 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.282 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.282 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:42.292 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:42.293 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:42.293 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:42.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:42.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:42.294 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.294 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.294 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:42.294 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:42.305 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:42.305 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:42.305 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:42.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.306 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.307 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:42.325 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:42.325 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:42.325 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:42.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.326 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.326 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.326 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.327 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.327 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.327 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.327 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:42.391 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.392 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.392 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.393 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.393 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.393 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.393 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.393 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.393 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.393 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.393 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.393 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.394 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.427 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:42.427 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:42.428 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:42.428 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:42.428 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:42.428 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:42.429 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:42.429 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:42.429 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:42.429 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:42.429 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:42.429 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:42.429 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:42.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:42.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:42.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:42.548 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:42.548 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:42.548 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:42.548 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:42.549 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:42.549 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:42.549 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:42.549 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:42.549 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:42.549 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:42.626 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:42.626 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:42.626 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:42.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.626 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:42.627 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.627 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.627 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:42.627 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.627 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.627 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:42.628 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:42.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512942662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:42.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.671 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:42.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:15:42.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:42.771 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:42.772 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:42.772 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:42.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.772 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.772 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.773 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:42.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:42.773 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:42.773 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:42.959 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:42.960 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:42.960 [DEBUG - pool-272-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:42.960 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:42.960 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:42.960 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:42.960 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:42.960 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:42.960 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:42.960 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:42.960 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:42.961 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:42.961 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:42.961 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27831), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [150ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [150ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [201ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [262ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [264ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [403ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [403ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [404ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [540ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [543ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [543ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [861ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [902ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2961ms] refreshing cache from master, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2962ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2963ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2963ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3440ms] refreshing cache from master, [3440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3442ms] too many traces: truncated at 100 traces, deferred=Deferred@1890437742(state=PENDING, result=null, callback=(continuation of Deferred@462000005 after retry RPC after error@291959347) -> (continuation of Deferred@876435539 after retry RPC after error@719133184) -> (continuation of Deferred@2113883513 after retry RPC after error@1538183071) -> (continuation of Deferred@93322105 after retry RPC after error@1195441362) -> (continuation of Deferred@1087628742 after retry RPC after error@1831602292) -> (continuation of Deferred@394420891 after retry RPC after error@1466219221) -> (continuation of Deferred@138840106 after retry RPC after error@86265598) -> (continuation of Deferred@20341371 after retry RPC after error@1937167002) -> (continuation of Deferred@1330447110 after retry RPC after error@1748625327) -> (continuation of Deferred@1512994153 after retry RPC after error@520724148) -> (continuation of Deferred@947645280 after retry RPC after error@534275935) -> (continuation of Deferred@913628400 after retry RPC after error@1700468916) -> (continuation of Deferred@35442580 after retry RPC after error@1579328023) -> (continuation of Deferred@1310811775 after retry RPC after error@1937922487) -> (continuation of Deferred@394676284 after retry RPC after error@1560244929) -> (continuation of Deferred@422110655 after retry RPC after error@2022066380) -> (continuation of Deferred@1575237704 after retry RPC after error@2057969743) -> (continuation of Deferred@619788216 after retry RPC after error@1861999554) -> (continuation of Deferred@312580141 after retry RPC after error@958560878) -> (continuation of Deferred@348378629 after retry RPC after error@618019476) -> (continuation of Deferred@975744723 after retry RPC after error@275989234) -> (continuation of Deferred@436915463 after retry RPC after error@261969480) -> (continuation of Deferred@1882992478 after retry RPC after error@2060621689), errback=(continuation of Deferred@462000005 after retry RPC after error@291959347) -> (continuation of Deferred@876435539 after retry RPC after error@719133184) -> (continuation of Deferred@2113883513 after retry RPC after error@1538183071) -> (continuation of Deferred@93322105 after retry RPC after error@1195441362) -> (continuation of Deferred@1087628742 after retry RPC after error@1831602292) -> (continuation of Deferred@394420891 after retry RPC after error@1466219221) -> (continuation of Deferred@138840106 after retry RPC after error@86265598) -> (continuation of Deferred@20341371 after retry RPC after error@1937167002) -> (continuation of Deferred@1330447110 after retry RPC after error@1748625327) -> (continuation of Deferred@1512994153 after retry RPC after error@520724148) -> (continuation of Deferred@947645280 after retry RPC after error@534275935) -> (continuation of Deferred@913628400 after retry RPC after error@1700468916) -> (continuation of Deferred@35442580 after retry RPC after error@1579328023) -> (continuation of Deferred@1310811775 after retry RPC after error@1937922487) -> (continuation of Deferred@394676284 after retry RPC after error@1560244929) -> (continuation of Deferred@422110655 after retry RPC after error@2022066380) -> (continuation of Deferred@1575237704 after retry RPC after error@2057969743) -> (continuation of Deferred@619788216 after retry RPC after error@1861999554) -> (continuation of Deferred@312580141 after retry RPC after error@958560878) -> (continuation of Deferred@348378629 after retry RPC after error@618019476) -> (continuation of Deferred@975744723 after retry RPC after error@275989234) -> (continuation of Deferred@436915463 after retry RPC after error@261969480) -> (continuation of Deferred@1882992478 after retry RPC after error@2060621689)))
12:15:43.000 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:43.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:43.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:43.001 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:43.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:43.001 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:43.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:43.001 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:43.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:43.002 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:43.002 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:43.002 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:43.002 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:43.013 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:43.013 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:43.013 [DEBUG - pool-276-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:43.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.014 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.014 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.014 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.014 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:43.015 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27870), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [12ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [60ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [61ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [110ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [110ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [283ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [283ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [525ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [526ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [881ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [881ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [881ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [882ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [902ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2620ms] refreshing cache from master, [2620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2623ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3480ms] refreshing cache from master, [3480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3481ms] too many traces: truncated at 100 traces, deferred=Deferred@216286031(state=PENDING, result=null, callback=(continuation of Deferred@1226125620 after retry RPC after error@214317178) -> (continuation of Deferred@26205580 after retry RPC after error@794757321) -> (continuation of Deferred@1327698055 after retry RPC after error@1922823409) -> (continuation of Deferred@218576019 after retry RPC after error@1514761402) -> (continuation of Deferred@230287452 after retry RPC after error@547924326) -> (continuation of Deferred@339714636 after retry RPC after error@84029645) -> (continuation of Deferred@1195098937 after retry RPC after error@582852897) -> (continuation of Deferred@1266244344 after retry RPC after error@1609142018) -> (continuation of Deferred@1188212173 after retry RPC after error@153729183) -> (continuation of Deferred@134647256 after retry RPC after error@461673029) -> (continuation of Deferred@1223424061 after retry RPC after error@205675775) -> (continuation of Deferred@815167714 after retry RPC after error@255836687) -> (continuation of Deferred@402848197 after retry RPC after error@112851870) -> (continuation of Deferred@99336899 after retry RPC after error@1949652939) -> (continuation of Deferred@2079741017 after retry RPC after error@844768690) -> (continuation of Deferred@1778124000 after retry RPC after error@925469979) -> (continuation of Deferred@2117354299 after retry RPC after error@497061626) -> (continuation of Deferred@351421098 after retry RPC after error@1875399802) -> (continuation of Deferred@859434787 after retry RPC after error@712470752) -> (continuation of Deferred@739672086 after retry RPC after error@22051434) -> (continuation of Deferred@2104286612 after retry RPC after error@1812808361) -> (continuation of Deferred@1946380558 after retry RPC after error@1988284110), errback=(continuation of Deferred@1226125620 after retry RPC after error@214317178) -> (continuation of Deferred@26205580 after retry RPC after error@794757321) -> (continuation of Deferred@1327698055 after retry RPC after error@1922823409) -> (continuation of Deferred@218576019 after retry RPC after error@1514761402) -> (continuation of Deferred@230287452 after retry RPC after error@547924326) -> (continuation of Deferred@339714636 after retry RPC after error@84029645) -> (continuation of Deferred@1195098937 after retry RPC after error@582852897) -> (continuation of Deferred@1266244344 after retry RPC after error@1609142018) -> (continuation of Deferred@1188212173 after retry RPC after error@153729183) -> (continuation of Deferred@134647256 after retry RPC after error@461673029) -> (continuation of Deferred@1223424061 after retry RPC after error@205675775) -> (continuation of Deferred@815167714 after retry RPC after error@255836687) -> (continuation of Deferred@402848197 after retry RPC after error@112851870) -> (continuation of Deferred@99336899 after retry RPC after error@1949652939) -> (continuation of Deferred@2079741017 after retry RPC after error@844768690) -> (continuation of Deferred@1778124000 after retry RPC after error@925469979) -> (continuation of Deferred@2117354299 after retry RPC after error@497061626) -> (continuation of Deferred@351421098 after retry RPC after error@1875399802) -> (continuation of Deferred@859434787 after retry RPC after error@712470752) -> (continuation of Deferred@739672086 after retry RPC after error@22051434) -> (continuation of Deferred@2104286612 after retry RPC after error@1812808361) -> (continuation of Deferred@1946380558 after retry RPC after error@1988284110)))
12:15:43.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.155 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:43.156 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:43.156 [DEBUG - pool-278-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:43.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.156 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:43.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:43.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:43.157 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:43.158 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28001), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [48ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [50ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [54ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [54ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [64ms] refreshing cache from master, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [90ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [96ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [125ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [185ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [186ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [463ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [463ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [463ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [902ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1622ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3560ms] refreshing cache from master, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3562ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3562ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [6200ms] refreshing cache from master, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6201ms] too many traces: truncated at 100 traces, deferred=Deferred@2057618096(state=PENDING, result=null, callback=(continuation of Deferred@1201362178 after retry RPC after error@1850654968) -> (continuation of Deferred@310982654 after retry RPC after error@1323615837) -> (continuation of Deferred@1397402054 after retry RPC after error@1268509271) -> (continuation of Deferred@284557853 after retry RPC after error@2026432624) -> (continuation of Deferred@2127198774 after retry RPC after error@1779953386) -> (continuation of Deferred@1255272287 after retry RPC after error@1969554717) -> (continuation of Deferred@1481890381 after retry RPC after error@233180947) -> (continuation of Deferred@1216914151 after retry RPC after error@362285830) -> (continuation of Deferred@1407138378 after retry RPC after error@1862019509) -> (continuation of Deferred@1668161815 after retry RPC after error@914085447) -> (continuation of Deferred@475834280 after retry RPC after error@325223447) -> (continuation of Deferred@18250229 after retry RPC after error@1773624958) -> (continuation of Deferred@279958791 after retry RPC after error@401254713) -> (continuation of Deferred@629253088 after retry RPC after error@1981177216) -> (continuation of Deferred@411023784 after retry RPC after error@1520335103) -> (continuation of Deferred@1923632879 after retry RPC after error@915863399) -> (continuation of Deferred@1405205220 after retry RPC after error@2050062819) -> (continuation of Deferred@1247715196 after retry RPC after error@1274176671) -> (continuation of Deferred@356180383 after retry RPC after error@1681222842) -> (continuation of Deferred@1521400383 after retry RPC after error@44104553) -> (continuation of Deferred@1087685819 after retry RPC after error@256585895) -> (continuation of Deferred@538643507 after retry RPC after error@635814122), errback=(continuation of Deferred@1201362178 after retry RPC after error@1850654968) -> (continuation of Deferred@310982654 after retry RPC after error@1323615837) -> (continuation of Deferred@1397402054 after retry RPC after error@1268509271) -> (continuation of Deferred@284557853 after retry RPC after error@2026432624) -> (continuation of Deferred@2127198774 after retry RPC after error@1779953386) -> (continuation of Deferred@1255272287 after retry RPC after error@1969554717) -> (continuation of Deferred@1481890381 after retry RPC after error@233180947) -> (continuation of Deferred@1216914151 after retry RPC after error@362285830) -> (continuation of Deferred@1407138378 after retry RPC after error@1862019509) -> (continuation of Deferred@1668161815 after retry RPC after error@914085447) -> (continuation of Deferred@475834280 after retry RPC after error@325223447) -> (continuation of Deferred@18250229 after retry RPC after error@1773624958) -> (continuation of Deferred@279958791 after retry RPC after error@401254713) -> (continuation of Deferred@629253088 after retry RPC after error@1981177216) -> (continuation of Deferred@411023784 after retry RPC after error@1520335103) -> (continuation of Deferred@1923632879 after retry RPC after error@915863399) -> (continuation of Deferred@1405205220 after retry RPC after error@2050062819) -> (continuation of Deferred@1247715196 after retry RPC after error@1274176671) -> (continuation of Deferred@356180383 after retry RPC after error@1681222842) -> (continuation of Deferred@1521400383 after retry RPC after error@44104553) -> (continuation of Deferred@1087685819 after retry RPC after error@256585895) -> (continuation of Deferred@538643507 after retry RPC after error@635814122)))
12:15:43.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512943162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:43.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.171 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:15:43.172 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:15:43.251 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:43.251 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:43.251 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:43.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:43.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:43.252 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:43.252 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:43.252 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:43.252 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:43.253 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:43.253 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:43.253 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:43.253 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:43.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.331 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:43.331 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:43.331 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:43.331 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:43.332 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:43.332 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:43.332 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:43.332 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:43.332 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:43.332 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:43.332 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:43.332 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:43.332 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:43.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:41.141799 21959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:43.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:42.514264 21957 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 21931
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:43.618844 21957 kernel_stack_watchdog.cc:198] Thread 21931 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 370ms:
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:43.619457 21931 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.477s	user 0.658s	sys 0.958s
12:15:43.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:43.619674 21962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:43.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:43.619800 21931 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.478s	user 0.658s	sys 0.958s
12:15:43.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:43.623147 21960 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2482 milliseconds
12:15:43.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.623167 21931 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:43.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.624369 21931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:43.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.626834 21931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:43.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.628222 21931 hybrid_clock.cc:648] HybridClock initialized: now 1783512943628172 us; error 56 us; skew 500 ppm
12:15:43.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.629046 21931 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:43.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.635607 21931 webserver.cc:533] Webserver started at http://127.21.36.129:43483/ using document root <none> and password file <none>
12:15:43.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.636505 21931 fs_manager.cc:362] Metadata directory not provided
12:15:43.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.636737 21931 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:43.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.637171 21931 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.641673 21931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data/instance:
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d04ef4271a25405d8f61303c957c20e0"
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:43 on dist-test-slave-vcgh"
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.642691 21931 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal/instance:
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d04ef4271a25405d8f61303c957c20e0"
12:15:43.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:43 on dist-test-slave-vcgh"
12:15:43.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.650182 21931 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:15:43.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.656226 21984 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.657310 21931 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:15:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.657609 21931 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal
12:15:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d04ef4271a25405d8f61303c957c20e0"
12:15:43.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:43 on dist-test-slave-vcgh"
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.657938 21931 fs_report.cc:389] FS layout report
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data/data
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:43.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:43.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512943662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:43.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.671 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:43.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:15:43.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.713814 21931 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:43.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.715459 21931 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:43.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.715873 21931 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:43.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.718955 21931 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:43.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.723404 21931 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:43.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.723665 21931 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:43.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.723934 21931 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:43.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.724072 21931 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:43.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:43.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:43.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:43.830 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:43.830 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:43.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:43.831 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:43.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:43.831 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:43.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:43.831 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:43.831 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:43.831 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:43.831 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.923384 21931 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.129:45281
12:15:43.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.923499 22097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.129:45281 every 8 connection(s)
12:15:43.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.926066 21931 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/data/info.pb
12:15:43.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.936071 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 21931
12:15:43.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.936714 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-0/wal/instance
12:15:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.952342 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:43.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/logs
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data/info.pb
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.130:0
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.130
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.130
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:43.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.969559 22098 heartbeater.cc:344] Connected to a master server at 127.21.36.188:41809
12:15:43.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.970048 22098 heartbeater.cc:461] Registering TS with master...
12:15:43.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.972047 22098 heartbeater.cc:507] Master 127.21.36.188:41809 requested a full tablet report, sending...
12:15:43.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.976032 21850 ts_manager.cc:194] Registered new tserver with Master: d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281)
12:15:43.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.978518 22100 heartbeater.cc:344] Connected to a master server at 127.21.36.190:33455
12:15:43.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.978856 22100 heartbeater.cc:461] Registering TS with master...
12:15:43.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.979652 22100 heartbeater.cc:507] Master 127.21.36.190:33455 requested a full tablet report, sending...
12:15:43.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.979970 22099 heartbeater.cc:344] Connected to a master server at 127.21.36.189:35221
12:15:43.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.980283 22099 heartbeater.cc:461] Registering TS with master...
12:15:43.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.981133 22099 heartbeater.cc:507] Master 127.21.36.189:35221 requested a full tablet report, sending...
12:15:43.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.982105 21695 ts_manager.cc:194] Registered new tserver with Master: d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281)
12:15:43.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.984097 21770 ts_manager.cc:194] Registered new tserver with Master: d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281)
12:15:43.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:43.984900 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.129:38635
12:15:44.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512944162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:44.167 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.172 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:44.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:15:44.209 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.209 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.209 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.210 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.210 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.210 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.210 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.231 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:44.231 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:44.231 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:44.232 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:44.232 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:44.232 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:44.232 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:44.232 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:44.232 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:44.233 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:44.233 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:44.233 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:44.233 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:44.269 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.308 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.309 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.309 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.310 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.310 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.310 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.358765 22108 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.359258 22108 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:44.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.359722 22108 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:44.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.394600 22108 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:44.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.395462 22108 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.130
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:44.434026 22108 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.130:0
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data/info.pb
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.130
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.130
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/logs
12:15:44.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:44.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:44.435302 22108 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:44.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:44.437003 22108 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:44.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.450192 22116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:44.513 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.513 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.513 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.513 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.513 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.515 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.606 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.606 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.606 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.607 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.607 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.607 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.608 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.608 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.608 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.608 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.631 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.631 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.631 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.631 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.631 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.632 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.632 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.632 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.632 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.632 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512944662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:44.666 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.666 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.666 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.666 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.667 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.667 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.667 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.667 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.667 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.667 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.667 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.667 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.667 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.667 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.668 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.668 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.667 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.669 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.669 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.669 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.669 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.669 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.670 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.670 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.670 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.679 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:15:44.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:15:44.701 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:44.701 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:44.701 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:44.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:44.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:44.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:44.702 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:44.702 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:44.702 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:44.702 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:44.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:44.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:44.703 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:44.712 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.712 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.712 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.713 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.713 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.713 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.713 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.713 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.713 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.713 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.713 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.713 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.714 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.769 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:44.786 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.786 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.786 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.787 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.787 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.787 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.793 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.793 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.793 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.794 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.794 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.794 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.794 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.794 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.794 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.806 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:44.806 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:44.806 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:44.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:44.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:44.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:44.807 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:44.812 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.813 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.813 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.813 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.813 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.813 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.814 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.920 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:44.920 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:44.921 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:44.921 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.921 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.921 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:44.921 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.921 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.921 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:44.922 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:44.922 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:44.922 [DEBUG - pool-274-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:44.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:44.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:44.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:44.922 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:44.923 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:44.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:44.923 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:44.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:44.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:44.923 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:44.923 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29786), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [10ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [11ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [12ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [12ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [128ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [128ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [128ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [146ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [147ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [147ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [163ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [180ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [180ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [202ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [245ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [246ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [246ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [583ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [583ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [583ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [981ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1920ms] refreshing cache from master, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1921ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1922ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2121ms] refreshing cache from master, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2123ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2960ms] refreshing cache from master, [2960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2961ms] too many traces: truncated at 100 traces, deferred=Deferred@1527258331(state=PENDING, result=null, callback=(continuation of Deferred@1945874923 after retry RPC after error@477410323) -> (continuation of Deferred@916085476 after retry RPC after error@770663976) -> (continuation of Deferred@53870231 after retry RPC after error@978851534) -> (continuation of Deferred@1584473627 after retry RPC after error@150590939) -> (continuation of Deferred@605311765 after retry RPC after error@1577115455) -> (continuation of Deferred@160856858 after retry RPC after error@1325867262) -> (continuation of Deferred@1225608944 after retry RPC after error@288135625) -> (continuation of Deferred@735604317 after retry RPC after error@1563343624) -> (continuation of Deferred@2121733267 after retry RPC after error@190855237) -> (continuation of Deferred@1663178226 after retry RPC after error@1266418789) -> (continuation of Deferred@233394709 after retry RPC after error@121758205) -> (continuation of Deferred@1950345570 after retry RPC after error@1607173292) -> (continuation of Deferred@418712762 after retry RPC after error@280184912) -> (continuation of Deferred@466405341 after retry RPC after error@404868844) -> (continuation of Deferred@671187342 after retry RPC after error@578465046) -> (continuation of Deferred@1609921707 after retry RPC after error@1236633367) -> (continuation of Deferred@1830580830 after retry RPC after error@452550902) -> (continuation of Deferred@1851596590 after retry RPC after error@188068045) -> (continuation of Deferred@95796599 after retry RPC after error@1419416551) -> (continuation of Deferred@1379418677 after retry RPC after error@1949119335) -> (continuation of Deferred@1557882512 after retry RPC after error@1558106951) -> (continuation of Deferred@1290210051 after retry RPC after error@1363980275) -> (continuation of Deferred@1453636780 after retry RPC after error@2093615572) -> (continuation of Deferred@142719581 after retry RPC after error@1007075209), errback=(continuation of Deferred@1945874923 after retry RPC after error@477410323) -> (continuation of Deferred@916085476 after retry RPC after error@770663976) -> (continuation of Deferred@53870231 after retry RPC after error@978851534) -> (continuation of Deferred@1584473627 after retry RPC after error@150590939) -> (continuation of Deferred@605311765 after retry RPC after error@1577115455) -> (continuation of Deferred@160856858 after retry RPC after error@1325867262) -> (continuation of Deferred@1225608944 after retry RPC after error@288135625) -> (continuation of Deferred@735604317 after retry RPC after error@1563343624) -> (continuation of Deferred@2121733267 after retry RPC after error@190855237) -> (continuation of Deferred@1663178226 after retry RPC after error@1266418789) -> (continuation of Deferred@233394709 after retry RPC after error@121758205) -> (continuation of Deferred@1950345570 after retry RPC after error@1607173292) -> (continuation of Deferred@418712762 after retry RPC after error@280184912) -> (continuation of Deferred@466405341 after retry RPC after error@404868844) -> (continuation of Deferred@671187342 after retry RPC after error@578465046) -> (continuation of Deferred@1609921707 after retry RPC after error@1236633367) -> (continuation of Deferred@1830580830 after retry RPC after error@452550902) -> (continuation of Deferred@1851596590 after retry RPC after error@188068045) -> (continuation of Deferred@95796599 after retry RPC after error@1419416551) -> (continuation of Deferred@1379418677 after retry RPC after error@1949119335) -> (continuation of Deferred@1557882512 after retry RPC after error@1558106951) -> (continuation of Deferred@1290210051 after retry RPC after error@1363980275) -> (continuation of Deferred@1453636780 after retry RPC after error@2093615572) -> (continuation of Deferred@142719581 after retry RPC after error@1007075209)))
12:15:44.924 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:44.925 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:44.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:44.988953 22100 heartbeater.cc:499] Master 127.21.36.190:33455 was elected leader, sending a full tablet report...
12:15:45.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:45.033 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:45.033 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:45.033 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:45.033 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.033 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.034 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:45.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512945162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:45.168 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:45.170 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:45.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:15:45.270 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:45.301 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:45.301 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:45.301 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:45.301 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.301 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.302 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.302 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.302 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.302 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.302 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.302 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:45.327 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:45.327 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:45.327 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:45.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:45.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:45.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:45.328 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:45.328 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:45.328 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:45.328 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:45.328 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:45.328 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:45.329 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:45.425 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:45.425 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:45.425 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:45.426 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.426 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.426 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.426 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.426 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.427 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.427 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.427 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.427 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:45.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:45.572 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:45.573 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:45.573 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:45.573 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.573 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.573 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:45.574 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.574 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.574 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:45.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:45.574 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:45.606 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:45.606 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:45.606 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:45.606 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.606 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.607 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.607 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.607 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.607 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.607 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.607 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.607 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.607 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:45.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512945662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:45.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:45.671 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:45.671 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:45.671 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:45.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:45.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.672 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:45.672 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.672 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:45.673 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:45.681 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
12:15:45.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:15:45.770 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:46.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:45.852418 22115 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 22108
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.037789 22115 kernel_stack_watchdog.cc:198] Thread 22108 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:46.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.039865 22108 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.588s	user 0.001s	sys 0.000s
12:15:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.040266 22108 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.589s	user 0.002s	sys 0.000s
12:15:46.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.040244 22118 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1587 milliseconds
12:15:46.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:44.450999 22117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:46.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.041590 22119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:46.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.041559 22108 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.044832 22108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:46.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.046960 22108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:46.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.048398 22108 hybrid_clock.cc:648] HybridClock initialized: now 1783512946048366 us; error 31 us; skew 500 ppm
12:15:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.049204 22108 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:46.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.054805 22108 webserver.cc:533] Webserver started at http://127.21.36.130:45049/ using document root <none> and password file <none>
12:15:46.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.055639 22108 fs_manager.cc:362] Metadata directory not provided
12:15:46.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.055814 22108 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:46.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.056203 22108 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:46.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.060477 22108 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data/instance:
12:15:46.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d2020977b084d98bff57776c1af7fc9"
12:15:46.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:46 on dist-test-slave-vcgh"
12:15:46.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.061558 22108 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal/instance:
12:15:46.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d2020977b084d98bff57776c1af7fc9"
12:15:46.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:46 on dist-test-slave-vcgh"
12:15:46.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.069008 22108 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
12:15:46.070 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:46.070 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:46.071 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:46.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:46.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:46.071 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:46.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:46.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:46.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:46.071 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:46.071 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:46.071 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:46.071 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:46.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.075891 22126 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.077119 22108 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:15:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.077513 22108 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal
12:15:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8d2020977b084d98bff57776c1af7fc9"
12:15:46.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:46 on dist-test-slave-vcgh"
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.077937 22108 fs_report.cc:389] FS layout report
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data/data
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:46.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:46.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.127619 22108 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:46.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.129061 22108 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:46.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.129485 22108 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:46.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.132041 22108 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:46.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.136039 22108 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:46.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.136233 22108 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:46.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.136444 22108 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:46.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.136605 22108 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:46.148 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:46.148 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:46.148 [DEBUG - pool-282-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:46.148 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:46.149 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:46.149 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:46.149 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:46.149 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:46.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:46.149 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:46.149 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:46.149 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:46.149 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:46.150 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [15ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [21ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [21ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [50ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [92ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [98ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [183ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [741ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [742ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1063ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1282ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1702ms] too many traces: truncated at 100 traces, deferred=Deferred@716565084(state=PENDING, result=null, callback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057), errback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057)))
12:15:46.151 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:46.151 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [15ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [21ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [21ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [50ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [92ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [98ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [183ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [741ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [742ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1063ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1282ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1702ms] too many traces: truncated at 100 traces, deferred=Deferred@716565084(state=PENDING, result=null, callback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057), errback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.254:37603
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:46.151 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:15:46.154 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:15:46.156 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28282), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [15ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [21ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [21ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [50ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [92ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [98ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [98ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [183ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [183ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [741ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [742ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [742ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1061ms] refreshing cache from master, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1063ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1063ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1280ms] refreshing cache from master, [1280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1281ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1282ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1702ms] too many traces: truncated at 100 traces, deferred=Deferred@716565084(state=PENDING, result=null, callback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057), errback=(continuation of Deferred@658064045 after retry RPC after error@1540527324) -> (continuation of Deferred@327837848 after retry RPC after error@375949247) -> (continuation of Deferred@2074706933 after retry RPC after error@873634856) -> (continuation of Deferred@1956445338 after retry RPC after error@647747785) -> (continuation of Deferred@295322052 after retry RPC after error@835288067) -> (continuation of Deferred@572665484 after retry RPC after error@1518860177) -> (continuation of Deferred@424675684 after retry RPC after error@1661159209) -> (continuation of Deferred@1357271947 after retry RPC after error@901254521) -> (continuation of Deferred@742009219 after retry RPC after error@1433999650) -> (continuation of Deferred@937517581 after retry RPC after error@1111974477) -> (continuation of Deferred@1070349751 after retry RPC after error@585204581) -> (continuation of Deferred@514616382 after retry RPC after error@1728065708) -> (continuation of Deferred@964659326 after retry RPC after error@388746911) -> (continuation of Deferred@1788583384 after retry RPC after error@217597303) -> (continuation of Deferred@1233195246 after retry RPC after error@9920631) -> (continuation of Deferred@911497440 after retry RPC after error@2026467488) -> (continuation of Deferred@957225271 after retry RPC after error@44122809) -> (continuation of Deferred@380016981 after retry RPC after error@635021137) -> (continuation of Deferred@1826080124 after retry RPC after error@1693181653) -> (continuation of Deferred@1185265452 after retry RPC after error@783184774) -> (continuation of Deferred@2080423690 after retry RPC after error@1206268689) -> (continuation of Deferred@747757590 after retry RPC after error@1904116801) -> (continuation of Deferred@142581131 after retry RPC after error@2130135342) -> (continuation of Deferred@1564837814 after retry RPC after error@1486642387) -> (continuation of Deferred@746262926 after retry RPC after error@1744929558) -> (continuation of Deferred@420004247 after retry RPC after error@591953057)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.254:37603
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:46.157 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:46.157 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
12:15:46.157 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:15:46.157 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:15:46.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512946162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:46.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:46.172 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:46.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:15:46.269 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:46.269 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:46.269 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:46.270 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.270 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.270 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.270 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.270 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.270 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.270 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.270 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:46.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.286923 22108 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.130:37613
12:15:46.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.287055 22238 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.130:37613 every 8 connection(s)
12:15:46.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.289500 22108 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/data/info.pb
12:15:46.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.292891 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22108
12:15:46.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.293393 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-1/wal/instance
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.314146 21650 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/logs
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data/info.pb
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.131:0
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.131
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.131
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:46.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:46.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.345871 22240 heartbeater.cc:344] Connected to a master server at 127.21.36.189:35221
12:15:46.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.346383 22240 heartbeater.cc:461] Registering TS with master...
12:15:46.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.347687 22240 heartbeater.cc:507] Master 127.21.36.189:35221 requested a full tablet report, sending...
12:15:46.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.348850 22241 heartbeater.cc:344] Connected to a master server at 127.21.36.190:33455
12:15:46.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.349200 22241 heartbeater.cc:461] Registering TS with master...
12:15:46.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.349202 22239 heartbeater.cc:344] Connected to a master server at 127.21.36.188:41809
12:15:46.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.349705 22239 heartbeater.cc:461] Registering TS with master...
12:15:46.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.350138 22241 heartbeater.cc:507] Master 127.21.36.190:33455 requested a full tablet report, sending...
12:15:46.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.350551 22239 heartbeater.cc:507] Master 127.21.36.188:41809 requested a full tablet report, sending...
12:15:46.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.351527 21770 ts_manager.cc:194] Registered new tserver with Master: 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:15:46.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.352869 21850 ts_manager.cc:194] Registered new tserver with Master: 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:15:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.353751 21695 ts_manager.cc:194] Registered new tserver with Master: 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:15:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.355523 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.130:41835
12:15:46.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:46.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.657585 22249 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:46.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.658102 22249 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:46.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.658643 22249 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:46.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512946661 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:46.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:46.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:46.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:15:46.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.694221 22249 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:46.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.695055 22249 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.36.131
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.733428 22249 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.36.148:38551
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.36.131:0
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:46.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data/info.pb
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.36.131
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.36.131
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/logs
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:46.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.734736 22249 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:46.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:46.736313 22249 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:46.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.748343 22256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:46.866 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:46.866 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:46.867 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:46.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.868 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.868 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.868 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.868 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.868 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.868 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:46.881 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:46.882 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:46.882 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:46.882 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:46.882 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:46.882 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:46.883 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:46.883 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:46.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:46.883 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:46.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:46.883 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:46.883 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:46.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:46.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:46.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:46.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:46.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:46.967 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:46.967 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:46.968 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:46.968 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:46.969 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:46.969 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.969 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.969 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:46.969 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.969 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.969 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:46.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.970 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:46.970 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:47.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:47.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512947161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:47.169 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:47.173 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:15:47.175 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:15:47.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:47.359576 22241 heartbeater.cc:499] Master 127.21.36.190:33455 was elected leader, sending a full tablet report...
12:15:47.432 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:47.432 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:47.432 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:47.433 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:47.433 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:47.433 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:47.433 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:47.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:47.433 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:47.433 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:47.433 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:47.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:47.434 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:47.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:47.606 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:47.607 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:47.607 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:47.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.608 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.608 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.608 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.608 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.608 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.609 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.609 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:47.621 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.621 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.621 [DEBUG - pool-280-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.622 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.622 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.622 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.622 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.622 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.622 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.623 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.623 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.623 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.623 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.623 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [52ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [55ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [56ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [69ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [143ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [143ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [163ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [265ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [322ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [323ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [826ms] refreshing cache from master, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [829ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [829ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1362ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2283ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2283ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@29964085(state=PENDING, result=null, callback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705), errback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705)))
12:15:47.624 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:15:47.625 [WARN - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [52ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [55ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [56ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [69ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [143ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [143ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [163ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [265ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [322ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [323ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [826ms] refreshing cache from master, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [829ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [829ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1362ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2283ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2283ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@29964085(state=PENDING, result=null, callback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705), errback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:47.625 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:15:47.627 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:15:47.661 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:47.662 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:47.662 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:47.662 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:15:47.663 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:15:47.664 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:15:47.665 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:47.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:47.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:47.666 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:47.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:47.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:47.666 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:47.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:47.666 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:47.666 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:47.667 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:15:47.669 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:47.669 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512947664 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:47.670 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:47.670 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:47.670 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:47.671 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.671 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.671 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.671 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.671 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.671 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:47.683 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
12:15:47.685 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:15:47.698 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:15:47.700 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:47.701 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
12:15:47.701 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 71b57ea17b002970ac3f421ada230e68
12:15:47.701 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:15:47.702 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 71b57ea17b002970ac3f421ada230e68.
12:15:47.705 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29778), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [52ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [55ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [56ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [56ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [66ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [69ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [69ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [103ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [103ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [143ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [143ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [163ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [262ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [263ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [265ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [322ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [323ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [826ms] refreshing cache from master, [826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [828ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [829ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [829ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1360ms] refreshing cache from master, [1360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1361ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1362ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1362ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2281ms] refreshing cache from master, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2282ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2283ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2283ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [6301ms] refreshing cache from master, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [6301ms] too many traces: truncated at 100 traces, deferred=Deferred@29964085(state=PENDING, result=null, callback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705), errback=(continuation of Deferred@1548516709 after retry RPC after error@514424519) -> (continuation of Deferred@966201883 after retry RPC after error@1907358339) -> (continuation of Deferred@1320617606 after retry RPC after error@465372881) -> (continuation of Deferred@440129655 after retry RPC after error@340673105) -> (continuation of Deferred@1656485224 after retry RPC after error@289668192) -> (continuation of Deferred@1434412639 after retry RPC after error@860220011) -> (continuation of Deferred@250108382 after retry RPC after error@4588703) -> (continuation of Deferred@774231894 after retry RPC after error@850359883) -> (continuation of Deferred@2126901097 after retry RPC after error@1318547154) -> (continuation of Deferred@1309183793 after retry RPC after error@131900821) -> (continuation of Deferred@1454619808 after retry RPC after error@589805914) -> (continuation of Deferred@702339848 after retry RPC after error@1271800747) -> (continuation of Deferred@13881550 after retry RPC after error@513819879) -> (continuation of Deferred@1366022304 after retry RPC after error@1795320413) -> (continuation of Deferred@1967755859 after retry RPC after error@1775396705) -> (continuation of Deferred@1727208483 after retry RPC after error@517722658) -> (continuation of Deferred@658051232 after retry RPC after error@1563066953) -> (continuation of Deferred@591830987 after retry RPC after error@1665930051) -> (continuation of Deferred@211792794 after retry RPC after error@95305866) -> (continuation of Deferred@302071603 after retry RPC after error@299163707) -> (continuation of Deferred@1613136632 after retry RPC after error@402334822) -> (continuation of Deferred@202926349 after retry RPC after error@981177741) -> (continuation of Deferred@1855906168 after retry RPC after error@537407705)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:47.707 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:47.707 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:47.707 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:47.708 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.708 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.708 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:47.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.708 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:47.708 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:47.709 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:47.710 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:47.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:47.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:47.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:47.711 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.711 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.711 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.711 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.712 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.712 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.712 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.712 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.712 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.712 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:47.713 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
12:15:47.713 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
12:15:47.713 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
12:15:47.713 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:15:47.713 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:15:47.714 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e02af12
12:15:47.714 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:47.714 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:15:47.714 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:15:47.715 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:15:47.717 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@11dd62bf
12:15:47.718 [ERROR - Source: KuduSource -> Sink: Writer (1/4)#2] (HashedWheelTimer.java:470) You are creating too many HashedWheelTimer instances. HashedWheelTimer is a shared resource that must be reused across the JVM, so that only a few instances are created.
12:15:47.719 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:47.729 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.736 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.737 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.737 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.737 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.737 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.738 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.738 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.738 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.754 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.770 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.770 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.771 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.771 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.771 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.772 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.772 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.772 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.772 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.773 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.773 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.773 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.773 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.790 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.790 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.791 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.791 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.791 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.792 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.792 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.792 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.792 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.828 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.828 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.828 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.849 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.850 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.850 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.850 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.850 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.850 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.851 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.869 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.869 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.869 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.870 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.870 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.870 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.870 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.870 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.871 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.871 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.871 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.871 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.905 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:47.906 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:47.906 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:47.906 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.906 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.906 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:47.906 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.906 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.907 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:47.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:47.907 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:47.910 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.910 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.910 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.910 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.910 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.910 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.911 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:47.970 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:47.970 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:47.970 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:47.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.970 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.970 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:47.971 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.971 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:47.971 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.971 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:47.971 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:48.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:48.030 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:48.030 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:48.030 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:48.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.031 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.031 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.031 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.031 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:48.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:46.749114 22257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:48.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:48.057607 22259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:48.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:48.059821 22249 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.310s	user 0.419s	sys 0.777s
12:15:48.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:48.060161 22249 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.311s	user 0.419s	sys 0.777s
12:15:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:48.062865 22258 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1305 milliseconds
12:15:48.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.062945 22249 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:48.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.064417 22249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:48.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.067193 22249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:48.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.070747 22249 hybrid_clock.cc:648] HybridClock initialized: now 1783512948070685 us; error 55 us; skew 500 ppm
12:15:48.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.071812 22249 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:48.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.080578 22249 webserver.cc:533] Webserver started at http://127.21.36.131:39195/ using document root <none> and password file <none>
12:15:48.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.081800 22249 fs_manager.cc:362] Metadata directory not provided
12:15:48.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.082067 22249 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:48.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.082578 22249 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:48.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.089126 22249 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data/instance:
12:15:48.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e24ca086a1e4322ad294d640b08f369"
12:15:48.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:48 on dist-test-slave-vcgh"
12:15:48.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.090737 22249 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal/instance:
12:15:48.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e24ca086a1e4322ad294d640b08f369"
12:15:48.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:48 on dist-test-slave-vcgh"
12:15:48.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.100080 22249 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.003s
12:15:48.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.107429 22278 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.108760 22249 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.005s
12:15:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.109130 22249 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal
12:15:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9e24ca086a1e4322ad294d640b08f369"
12:15:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:48 on dist-test-slave-vcgh"
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.109536 22249 fs_report.cc:389] FS layout report
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data/data
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:48.120 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:48.120 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:48.120 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:48.121 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.122 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:48.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512948161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:48.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:48.169 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:48.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:15:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.202360 22249 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.203866 22249 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.204270 22249 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:48.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.207006 22249 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.211189 22249 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.211388 22249 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:15:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.211586 22249 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:48.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.211709 22249 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:48.269 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:48.269 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:48.270 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:48.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.270 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.271 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:48.332 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:48.332 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:48.332 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:48.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.333 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.333 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.333 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.333 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.333 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.333 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:48.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.348062 22249 rpc_server.cc:307] RPC server started. Bound to: 127.21.36.131:43095
12:15:48.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.348181 22391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.36.131:43095 every 8 connection(s)
12:15:48.349 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:48.349 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:48.349 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:48.350 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.350 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.350 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.350 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.350 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.350 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.350 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.350 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.350 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.350 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:48.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.351081 22249 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/data/info.pb
12:15:48.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.351845 21650 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22249
12:15:48.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.352308 21650 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster17595737495597193026/ts-2/wal/instance
12:15:48.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.402503 22394 heartbeater.cc:344] Connected to a master server at 127.21.36.190:33455
12:15:48.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.402992 22394 heartbeater.cc:461] Registering TS with master...
12:15:48.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.404383 22394 heartbeater.cc:507] Master 127.21.36.190:33455 requested a full tablet report, sending...
12:15:48.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.405833 22393 heartbeater.cc:344] Connected to a master server at 127.21.36.189:35221
12:15:48.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.406010 22392 heartbeater.cc:344] Connected to a master server at 127.21.36.188:41809
12:15:48.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.406152 22393 heartbeater.cc:461] Registering TS with master...
12:15:48.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.406350 22392 heartbeater.cc:461] Registering TS with master...
12:15:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.406957 22393 heartbeater.cc:507] Master 127.21.36.189:35221 requested a full tablet report, sending...
12:15:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.407223 22392 heartbeater.cc:507] Master 127.21.36.188:41809 requested a full tablet report, sending...
12:15:48.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.407440 21695 ts_manager.cc:194] Registered new tserver with Master: 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:15:48.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.409077 21695 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.36.131:49943
12:15:48.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.409466 21770 ts_manager.cc:194] Registered new tserver with Master: 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:15:48.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.409920 21850 ts_manager.cc:194] Registered new tserver with Master: 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:15:48.411 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:48.411 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:48.411 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:48.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.412 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.412 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.412 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.412 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.412 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.412 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.412 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:48.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.421948 21650 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:15:48.433 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:48.433 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:15:48.434 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.36.190"
      port: 33455
    }
    bound_http_address {
      host: "127.21.36.190"
      port: 37173
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.36.189"
      port: 35221
    }
    bound_http_address {
      host: "127.21.36.189"
      port: 39141
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.36.188"
      port: 41809
    }
    bound_http_address {
      host: "127.21.36.188"
      port: 42893
    }
  }
}

12:15:48.434 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:15:48.435 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.36.129"
      port: 45281
    }
    bound_http_address {
      host: "127.21.36.129"
      port: 43483
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.36.130"
      port: 37613
    }
    bound_http_address {
      host: "127.21.36.130"
      port: 45049
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.36.131"
      port: 43095
    }
    bound_http_address {
      host: "127.21.36.131"
      port: 39195
    }
  }
}

12:15:48.435 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:15:48.436 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:48.436 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:15:48.436 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:15:48.437 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:15:48.437 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:15:48.441 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:15:48.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:48.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:48.453 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:48.453 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.453 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.453 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:48.453 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.453 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.453 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:48.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:48.454 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:48.525 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:48.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:48.525 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:48.525 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:48.526 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.526 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.526 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.526 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:48.545 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:48.546 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:48.546 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:48.546 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.546 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.546 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.546 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.546 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:48.546 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:48.546 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.546 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.546 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:48.547 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:48.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512948661 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:48.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:48.670 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:48.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:15:48.672 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:48.672 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:48.672 [DEBUG - pool-270-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:48.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.672 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.672 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.672 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.672 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.672 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:48.672 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:48.672 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:48.673 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:48.787 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:15:48.788 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:15:48.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.791041 22402 mini_oidc.cc:150] Starting JWKS server
12:15:48.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.794139 22402 webserver.cc:533] Webserver started at http://127.0.0.1:37579/ using document root <none> and password file <none>
12:15:48.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.794584 22402 mini_oidc.cc:186] Starting OIDC Discovery server
12:15:48.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.796183 22402 webserver.cc:533] Webserver started at http://127.0.0.1:43295/ using document root <none> and password file <none>
12:15:48.809 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:48.809 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:48.809 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:48.809 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.809 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.809 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.810 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.810 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:48.810 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:48.810 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.810 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:48.810 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:48.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:48Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:15:48.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:15:48Z Disabled control of system clock
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:48.857836 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/logs
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data/info.pb
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.190:35543
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.190
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:48.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json with env {}
12:15:49.013 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:49.013 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:49.013 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:49.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:49.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:49.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:49.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:49.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:49.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:49.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:49.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:49.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:49.014 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:49.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:49.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512949162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:49.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:49.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:15:49.170 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:15:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.174857 22414 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.175428 22414 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:49.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.175925 22414 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.209537 22414 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:49.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.209841 22414 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:49.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.210088 22414 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:49.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.210306 22414 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:49.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.210498 22414 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:49.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.210641 22414 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37579/jwks.json
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:49.248170 22414 master_runner.cc:387] Master server non-default flags:
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.190:35543
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:49.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data/info.pb
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.190
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/logs
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:49.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:49.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:49.249742 22414 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:49.251370 22414 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:49.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.262641 22420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:49.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:49.414608 22394 heartbeater.cc:499] Master 127.21.36.190:33455 was elected leader, sending a full tablet report...
12:15:49.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:49.665 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512949662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:49.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:49.679 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:15:49.681 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:15:49.804 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:15:49.805 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:15:49.806 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:15:49.806 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:15:49.809 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
12:15:49.810 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:49.810 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
12:15:49.810 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:15:49.810 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
12:15:49.810 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:15:49.811 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
12:15:49.811 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:15:49.811 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
12:15:49.811 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:15:49.812 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
12:15:49.813 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:49.813 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:15:49.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
12:15:49.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
12:15:49.814 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
12:15:49.814 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:15:49.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@63c03ac2
12:15:49.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:49.814 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:49.815 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
12:15:49.815 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
12:15:49.815 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:15:49.816 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:15:49.817 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:15:49.818 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:15:49.818 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
12:15:49.818 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
12:15:49.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50dc7284
12:15:49.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:49.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:49.819 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
12:15:49.819 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@183fefea
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:49.820 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
12:15:49.820 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
12:15:49.821 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
12:15:49.821 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
12:15:49.821 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@703327af
12:15:49.821 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:49.822 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:15:49.822 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
12:15:49.822 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
12:15:49.829 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@676958ca
12:15:49.833 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b56e34b
12:15:49.835 [INFO - Thread-54] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:15:49.836 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:15:49.836 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5fa09f4
12:15:49.836 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:15:49.836 [DEBUG - Thread-54] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:15:49.836 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:49.837 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1d1ae96e
12:15:49.838 [INFO - Thread-54] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:15:49.839 [INFO - Thread-54] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:15:49.842 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:49.845 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:49.849 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:49.849 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:49.849 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:49.850 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:49.850 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:49.850 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:49.850 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:49.850 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:49.850 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:49.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:49.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:49.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:49.851 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:49.851 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:49.852 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:49.852 [DEBUG - Thread-54] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:49.852 [INFO - Thread-54] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:15:49.853 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.857 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.858 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.858 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.858 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.860 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.860 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.860 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.877 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.880 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.893 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.896 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.896 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.896 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.896 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.897 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:49.897 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:49.897 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:49.897 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:15:49.898 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.900 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.901 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.901 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.901 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.908 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.909 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.909 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.909 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.913 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.921 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.930 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:49.930 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:49.931 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:49.931 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:49.931 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:49.931 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:49.932 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:49.932 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:49.932 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:49.932 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:49.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:49.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:49.932 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:49.932 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.933 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.933 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.933 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.944 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.947 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.947 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.948 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.948 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.948 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.957 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:49.965 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:49.965 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:49.966 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:49.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:49.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:49.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:49.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:49.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:49.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:49.967 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:49.967 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:49.967 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:49.967 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:49.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.976 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.977 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.977 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.978 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.978 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.978 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.978 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.980 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.985 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:49.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:49.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:49.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:49.986 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:49.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:49.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:49.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:49.988 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:49.988 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:49.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:49.988 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:49.989 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.989 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.989 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.989 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.989 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.990 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.990 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.990 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.990 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.993 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.993 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.993 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.993 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.993 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.993 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.993 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.994 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.993 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.995 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.996 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.996 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.996 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.997 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.997 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.997 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.997 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:49.997 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:49.997 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:49.997 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:49.998 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.998 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.998 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:49.998 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:49.998 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.999 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.999 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:49.999 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.999 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.999 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:49.999 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.001 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.009 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.010 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.010 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:50.010 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:50.011 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:50.011 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.011 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.011 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.011 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.011 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.011 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.012 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.012 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.012 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.012 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:50.012 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.016 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.021 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.021 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.013 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.013 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.021 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.021 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.021 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.021 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.021 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.021 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.021 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.021 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.021 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.022 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.022 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.022 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.022 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.022 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.022 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.028 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.029 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.029 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.029 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.029 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.029 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.029 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.029 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.029 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.029 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.029 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.029 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.030 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.030 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.030 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.030 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.032 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.032 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.032 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.032 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.033 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.033 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.033 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.033 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.034 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.034 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.034 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.035 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.035 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.035 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.037 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.038 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.038 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.038 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.039 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.039 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.039 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.039 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.040 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.041 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.042 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.042 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.042 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.042 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.042 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.042 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.042 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.042 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.042 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.053 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.053 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.053 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.054 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.054 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.054 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.054 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.054 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.055 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.055 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.055 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.055 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.058 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.058 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.058 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.059 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.060 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.060 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.060 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.060 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.060 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.054 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.060 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.060 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.060 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.055 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.060 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.061 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.060 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.061 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.061 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.061 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.061 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.061 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.061 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.061 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.062 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.062 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.062 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.062 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.062 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.062 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.062 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.062 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.062 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.062 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.063 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.063 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.063 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:50.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:50.069 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:50.069 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.069 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.069 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.070 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.070 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.070 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.070 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.070 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.070 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.070 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:50.074 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.074 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.074 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.075 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.075 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.075 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.075 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.077 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.077 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.077 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.077 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.077 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.077 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.078 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.078 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.078 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.078 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.078 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.078 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.078 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.078 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.078 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.078 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.079 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.079 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.081 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.081 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.081 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.081 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.093 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.094 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.094 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.094 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.094 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.094 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.094 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.094 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.095 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.095 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.095 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.095 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.093 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.095 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.095 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.097 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.097 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.098 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.098 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.098 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.098 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.098 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.098 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.098 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.098 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.098 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.099 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.099 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.099 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.099 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.102 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.103 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.103 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.103 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.104 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.104 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.104 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.104 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.104 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.104 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.098 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.105 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.133 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:15:50.134 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:15:50.134 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.134 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.134 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.135 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.135 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.135 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.135 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.135 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.135 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.139 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.139 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.139 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.140 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.140 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.140 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.140 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.140 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.140 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.141 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.141 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.141 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.141 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.135 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.148 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.148 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.148 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.150 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:15:50.150 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
12:15:50.151 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:15:50.152 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:15:50.154 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.154 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.154 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.156 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.156 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.157 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.157 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.157 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.157 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512950163 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:50.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.166 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
12:15:50.166 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 662c4bfa88ebb225fdaa868646c1528c
12:15:50.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.178 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.178 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.179 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.179 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.179 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.179 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.182 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.182 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.182 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.182 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.183 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:15:50.184 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:15:50.185 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 662c4bfa88ebb225fdaa868646c1528c.
12:15:50.197 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.197 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.198 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.198 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.198 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.198 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.198 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.198 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.198 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.198 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.210 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id 662c4bfa88ebb225fdaa868646c1528c.
12:15:50.230 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
12:15:50.230 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
12:15:50.236 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4e925b58
12:15:50.236 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:15:50.237 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:15:50.238 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:15:50.238 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:15:50.249 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1648b079
12:15:50.255 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:15:50.261 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.261 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.261 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.262 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.262 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.262 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.262 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.263 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.264 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.265 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.265 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.266 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.266 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.267 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.267 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.267 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.267 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.267 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.267 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.267 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.273 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.273 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.273 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.274 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.274 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.274 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.275 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.275 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.281 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.282 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.284 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.289 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.289 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.290 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.290 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.291 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.291 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.291 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.291 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.292 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.292 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.297 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.297 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.298 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.298 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.298 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.298 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.298 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.298 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.298 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.299 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.299 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.299 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.299 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.301 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.302 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.303 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.303 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.303 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.304 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.317 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.317 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.317 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.318 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.318 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.318 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.318 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.318 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.319 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.319 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.319 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.319 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.319 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.321 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.321 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.321 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.322 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.322 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.322 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.322 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.322 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.322 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.322 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.322 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.322 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.323 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.334 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.334 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.335 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.335 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.335 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.336 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.336 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.336 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.341 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.341 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.341 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.341 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.341 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.342 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.342 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.381 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.381 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.381 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.382 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.382 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.382 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.382 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.382 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.382 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.383 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.383 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.383 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.399 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.399 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.399 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.400 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.400 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.400 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.400 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.400 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.401 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.401 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.401 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.401 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.461 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.461 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.462 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.462 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.462 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.462 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.463 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.463 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.507 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:50.507 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:50.507 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:50.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.507 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.507 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.507 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.508 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.508 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:50.520 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.521 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.521 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.521 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.521 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.521 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.521 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.521 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.521 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.521 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.521 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.521 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.521 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.533 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.534 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.534 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.534 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.534 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.534 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.534 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.535 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.535 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.535 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.538 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.538 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.538 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.538 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.538 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.538 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.538 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.538 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.538 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.539 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.539 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.539 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.539 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.553 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.553 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.554 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.554 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.554 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.554 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.555 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.602 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.602 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.602 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.603 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.603 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:49.263170 22421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:50.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.615330 22423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.617919 22414 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.355s	user 0.497s	sys 0.793s
12:15:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.618302 22414 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.356s	user 0.497s	sys 0.793s
12:15:50.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.618731 22422 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1350 milliseconds
12:15:50.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.618777 22414 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:50.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.620360 22414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:50.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.623706 22414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.625238 22414 hybrid_clock.cc:648] HybridClock initialized: now 1783512950625194 us; error 32 us; skew 500 ppm
12:15:50.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.626289 22414 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:50.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.635093 22414 webserver.cc:533] Webserver started at http://127.21.224.190:32789/ using document root <none> and password file <none>
12:15:50.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.636432 22414 fs_manager.cc:362] Metadata directory not provided
12:15:50.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.636785 22414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:50.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.637341 22414 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:50.637 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.638 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.638 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.638 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.638 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.638 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.638 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.638 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.638 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.638 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.638 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.638 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.643606 22414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data/instance:
12:15:50.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28bbd12b88ad4557b35ac7f3e36f018f"
12:15:50.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:50 on dist-test-slave-vcgh"
12:15:50.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.645145 22414 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal/instance:
12:15:50.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28bbd12b88ad4557b35ac7f3e36f018f"
12:15:50.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:50 on dist-test-slave-vcgh"
12:15:50.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:50.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:50.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:50.647 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.647 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.648 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:50.648 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.648 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.648 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:50.647 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.648 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.648 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:50.648 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:50.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.654722 22414 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
12:15:50.657 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.657 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.657 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.658 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.658 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.658 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.658 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.658 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.658 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.658 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.658 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.658 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.662252 22493 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:50.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512950662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:50.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.663687 22414 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.003s
12:15:50.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.664134 22414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal
12:15:50.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "28bbd12b88ad4557b35ac7f3e36f018f"
12:15:50.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:50 on dist-test-slave-vcgh"
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.664665 22414 fs_report.cc:389] FS layout report
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data/data
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:50.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.669 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:15:50.670 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:15:50.701 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.701 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.701 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.701 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.702 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.702 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.702 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.702 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.702 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.702 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.702 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.702 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.741802 22414 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:50.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.743798 22414 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:50.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.744361 22414 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:50.757 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.757 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.757 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.757 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.757 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.758 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.758 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.758 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.758 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:50.800 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:50.801 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:50.801 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:50.801 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:50.801 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:50.801 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:50.801 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:50.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:50.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:50.802 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:50.801 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:50.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:50.802 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:50.811 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:50.811 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:50.811 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:50.811 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.812 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.812 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.812 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.812 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.812 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.812 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:50.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.820452 22414 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.190:35543
12:15:50.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.820596 22544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.190:35543 every 8 connection(s)
12:15:50.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.823369 22414 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/data/info.pb
12:15:50.829 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:50.829 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:50.829 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:50.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:50.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:50.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:50.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:50.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:50.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:50.830 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:50.830 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:50.830 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:50.830 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:50.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.830405 22545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:50.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.831223 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22414
12:15:50.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.831681 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-0/wal/instance
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.837165 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/logs
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data/info.pb
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:50.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.189:39039
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.189
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:50.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json with env {}
12:15:50.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.843278 22545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } has no permanent_uuid. Determining permanent_uuid...
12:15:50.873 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.874 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.874 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.874 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.874 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.874 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.874 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.874 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.874 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.874 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.878975 22545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } has no permanent_uuid. Determining permanent_uuid...
12:15:50.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.881875 22496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:50.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.886451 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:50.917 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:50.918 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:50.918 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:50.918 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.918 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.918 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.918 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.918 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:50.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:50.918 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:50.919 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:50.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:50.936023 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 1
12:15:50.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:50.940640 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:50.941 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:50.941 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:50.941 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:50.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.942 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.942 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:50.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.942 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.942 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:50.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.942 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.942 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:50.942 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:50.960 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:50.961 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:50.961 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:50.961 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.961 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.961 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.961 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:50.961 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:50.961 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.961 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.961 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:50.961 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:50.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:50.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:50.965 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:50.965 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.965 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.965 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.965 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:50.965 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.965 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:50.966 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.966 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.966 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:50.966 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:51.000 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:51.000 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:51.001 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:51.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.001 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.001 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.001 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.001 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.001 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.001 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.001 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:51.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.009052 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 2
12:15:51.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.013446 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:51.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.104956 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 3
12:15:51.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.109350 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:51.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.161948 22547 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:51.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.162583 22547 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:51.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512951162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:51.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.163116 22547 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:51.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:51.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:15:51.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.207846 22547 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:51.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.208182 22547 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:51.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.208493 22547 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:51.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.208827 22547 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.209040 22547 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.209188 22547 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37579/jwks.json
12:15:51.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.223376 22235 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6b80 after lost signal to thread 22111
12:15:51.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.224308 22235 debug-util.cc:398] Leaking SignalData structure 0x7b08000b46e0 after lost signal to thread 22238
12:15:51.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.247551 22547 master_runner.cc:387] Master server non-default flags:
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.189:39039
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data/info.pb
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.189
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/logs
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:51.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:51.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.248972 22547 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:51.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.250590 22547 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:51.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.252754 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 4
12:15:51.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.258016 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:51.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.263630 22557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:51.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:51.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:51.334 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:51.334 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.335 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.335 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:51.421 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:51.421 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:51.421 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:51.422 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.422 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.422 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.422 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.422 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.422 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.423 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.423 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.423 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.423 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:51.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:51.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:51.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:51.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.531 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.532 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.532 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.532 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:51.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:51.557483 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 5
12:15:51.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.563331 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:51.582 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:51.582 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:51.583 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:51.583 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:51.583 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:51.583 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:51.584 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:51.584 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:51.584 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:51.584 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:51.584 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:51.584 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:51.584 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:51.593 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:51.593 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:51.593 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:51.594 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.594 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.594 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.594 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.594 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.595 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.595 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:51.613 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:51.613 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:51.613 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:51.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:51.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:51.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:51.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:51.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:51.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:51.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:51.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:51.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:51.615 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:51.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:51.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:51.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:51.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:51.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:51.651 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.651 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.651 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:51.651 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:51.665 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512951663 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:51.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.681 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=17 ms, finalizationTime=1 ms).
12:15:51.683 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:15:51.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:51.957 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:51.957 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:51.957 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:51.958 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.958 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.958 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:51.959 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.959 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.959 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:51.959 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.959 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.959 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:51.959 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:52.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.110797 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 6
12:15:52.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:52.130059 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.189:39039: Network error: Client connection negotiation failed: client connection to 127.21.224.189:39039: connect: Connection refused (error 111)
12:15:52.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512952162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:52.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.174 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:15:52.175 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:15:52.221 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:52.221 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:52.221 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:52.221 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.221 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.222 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.222 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.222 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.222 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.222 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.222 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.222 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.222 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:52.228 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:52.229 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:52.229 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:52.229 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.229 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.229 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.230 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.230 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:52.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.347 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:52.347 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:52.347 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:52.348 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.348 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.348 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.348 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.348 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.348 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.348 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.349 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.349 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.349 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:52.492 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:52.492 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:52.492 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:52.493 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.493 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.493 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:52.493 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.493 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.493 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:52.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:52.494 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:52.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:52.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:52.547 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:52.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:52.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.548 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.548 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:52.548 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.549 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.549 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:52.549 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:52.591 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:52.591 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:52.591 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:52.592 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.592 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.592 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.592 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.592 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.592 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.592 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.593 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:52.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512952662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:52.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.671 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:52.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:15:52.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:51.282979 22558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:52.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:52.672837 22559 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1389 milliseconds
12:15:52.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.673025 22547 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:52.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:52.673025 22560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:52.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.678130 22547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:52.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.681109 22547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:52.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.682504 22547 hybrid_clock.cc:648] HybridClock initialized: now 1783512952682422 us; error 74 us; skew 500 ppm
12:15:52.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.683758 22547 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:52.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.691761 22547 webserver.cc:533] Webserver started at http://127.21.224.189:43695/ using document root <none> and password file <none>
12:15:52.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.692966 22547 fs_manager.cc:362] Metadata directory not provided
12:15:52.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.693292 22547 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:52.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.693893 22547 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:52.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.700364 22547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data/instance:
12:15:52.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33040064a2cd4217bdd6b46573dd9bcb"
12:15:52.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:52 on dist-test-slave-vcgh"
12:15:52.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.701956 22547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal/instance:
12:15:52.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33040064a2cd4217bdd6b46573dd9bcb"
12:15:52.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:52 on dist-test-slave-vcgh"
12:15:52.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.711433 22547 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
12:15:52.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.719025 22569 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:52.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.720234 22547 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.720605 22547 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "33040064a2cd4217bdd6b46573dd9bcb"
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:52 on dist-test-slave-vcgh"
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.721048 22547 fs_report.cc:389] FS layout report
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data/data
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:52.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:52.753 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:52.753 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:52.754 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:52.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.754 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.754 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.754 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.754 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:52.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:52.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.776719 22547 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:52.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.778335 22547 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:52.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.778821 22547 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:52.845 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:52.845 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:52.845 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:52.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:52.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:52.847 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.847 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.847 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:52.847 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:52.857 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:52.857 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:52.857 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:52.857 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:52.857 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:52.858 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:52.858 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:52.858 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:52.858 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:52.858 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:52.858 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:52.858 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:52.858 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:52.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.905609 22547 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.189:39039
12:15:52.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.905671 22620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.189:39039 every 8 connection(s)
12:15:52.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.908499 22547 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/data/info.pb
12:15:52.913 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:52.913 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:52.913 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:52.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.914 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:52.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:52.915 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.915 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.915 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:52.915 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.913594 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22547
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.914052 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-1/wal/instance
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.916821 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/logs
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data/info.pb
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.188:40821
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.188
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json with env {}
12:15:52.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.918650 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:52.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.936002 22621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } has no permanent_uuid. Determining permanent_uuid...
12:15:52.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.974226 22621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } has no permanent_uuid. Determining permanent_uuid...
12:15:52.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:52.992847 22621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } has no permanent_uuid. Determining permanent_uuid...
12:15:52.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:52.995748 22570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.000402 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.010 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:53.010 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:53.010 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:53.010 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.010 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.010 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.010 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.010 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.010 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.011 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.011 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.011 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:53.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.049960 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 1
12:15:53.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.055277 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.123719 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 2
12:15:53.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.128927 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512953162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:53.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:53.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:15:53.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.190526 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } attempt: 7
12:15:53.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.207391 22545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } has no permanent_uuid. Determining permanent_uuid...
12:15:53.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.220330 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 3
12:15:53.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.226226 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.226 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:53.227 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:53.227 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:53.227 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:53.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:53.227 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:53.228 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:53.228 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:53.228 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:53.228 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:53.228 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:53.228 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:53.228 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:53.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.230891 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.282791 22623 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:53.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.283354 22623 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:53.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.283816 22623 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:53.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.289350 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 1
12:15:53.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.301098 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.321 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:53.321 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:53.322 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:53.322 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.322 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.322 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.322 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:53.322 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.322 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:53.322 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.322 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.322 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:53.322 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:53.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.338445 22623 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:15:53.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.338732 22623 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:53.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.338949 22623 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:15:53.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.339186 22623 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:15:53.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.339430 22623 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:15:53.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.339587 22623 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37579/jwks.json
12:15:53.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.369642 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 4
12:15:53.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.374099 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.379850 22623 master_runner.cc:387] Master server non-default flags:
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.188:40821
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37579/jwks.json
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data/info.pb
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.188
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/logs
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:53.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:53.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.381378 22623 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:53.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.382568 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 2
12:15:53.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.383026 22623 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:53.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.386831 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.394856 22635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:53.454 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:53.454 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:53.454 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:53.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:53.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:53.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:53.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:53.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:53.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:53.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:53.455 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:53.455 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:53.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:53.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.472222 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 3
12:15:53.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.481069 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.621549 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 4
12:15:53.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.629897 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512953662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:53.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.673 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:15:53.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.673480 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 5
12:15:53.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:15:53.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.682453 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:53.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:53.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:53.913350 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 5
12:15:53.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.921985 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:54.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:54.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:54.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:54.001 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:54.001 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:54.001 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:54.001 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:54.001 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:54.001 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:54.002 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:54.002 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:54.002 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:54.002 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:54.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512954162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:54.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.175 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:15:54.176 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:15:54.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:54.229929 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 6
12:15:54.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:54.258468 22621 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:54.275 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.306 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:54.306 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:54.306 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:54.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.307 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.307 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.307 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.308 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.308 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:54.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:54.326290 22235 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6fa0 after lost signal to thread 22111
12:15:54.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:54.327458 22235 debug-util.cc:398] Leaking SignalData structure 0x7b08000adb80 after lost signal to thread 22238
12:15:54.367 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:54.367 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:54.367 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:54.367 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.368 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.368 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.368 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.368 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.368 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.368 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.368 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.369 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:54.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:54.474402 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 6
12:15:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:54.510370 22545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.224.188:40821: Network error: Client connection negotiation failed: client connection to 127.21.224.188:40821: connect: Connection refused (error 111)
12:15:54.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.530 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:54.530 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:54.530 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:54.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:54.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:54.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:54.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:54.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:54.531 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:54.532 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:54.532 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:54.532 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:54.532 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:54.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512954661 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:54.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.678 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:15:54.680 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:15:54.777 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:54.785 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:54.786 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:54.786 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:54.786 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.786 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.786 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:54.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:54.787 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.787 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.787 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:54.787 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:54.860 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:54.861 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:54.861 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:54.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.861 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.861 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.861 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.862 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.862 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.862 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.862 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:54.892 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:54.893 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:54.893 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:54.893 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.893 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.893 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:54.894 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.894 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.894 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:54.894 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.894 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.894 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:54.894 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:54.900 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:54.901 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:54.901 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:54.901 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.901 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.901 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.902 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:54.954 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:54.954 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:54.954 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:54.954 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.954 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.954 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:54.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:54.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.955 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.955 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:54.955 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:54.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:54.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:54.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:54.979 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:54.979 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:54.979 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:54.979 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:54.979 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:54.979 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:54.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:54.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:54.980 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:54.980 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:55.028 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:53.395551 22636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:54.796803 22634 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 22623
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.058283 22634 kernel_stack_watchdog.cc:198] Thread 22623 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 398ms:
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:55.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:55.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.062011 22623 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.666s	user 0.630s	sys 0.931s
12:15:55.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.062389 22623 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.667s	user 0.630s	sys 0.931s
12:15:55.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.062572 22637 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1666 milliseconds
12:15:55.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.063711 22638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:55.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.063767 22623 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:15:55.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.064972 22623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:55.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.067339 22623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:55.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.070785 22623 hybrid_clock.cc:648] HybridClock initialized: now 1783512955070744 us; error 49 us; skew 500 ppm
12:15:55.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.071656 22623 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:55.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.081089 22623 webserver.cc:533] Webserver started at http://127.21.224.188:42047/ using document root <none> and password file <none>
12:15:55.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.082177 22623 fs_manager.cc:362] Metadata directory not provided
12:15:55.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.082438 22623 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:55.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.082969 22623 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:55.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.087747 22623 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data/instance:
12:15:55.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5a4245333f34618846b0a3b8d94c7c1"
12:15:55.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:55 on dist-test-slave-vcgh"
12:15:55.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.089026 22623 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal/instance:
12:15:55.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5a4245333f34618846b0a3b8d94c7c1"
12:15:55.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:55 on dist-test-slave-vcgh"
12:15:55.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.096477 22623 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
12:15:55.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.102152 22652 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:55.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.103176 22623 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:15:55.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.103503 22623 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal
12:15:55.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c5a4245333f34618846b0a3b8d94c7c1"
12:15:55.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:55 on dist-test-slave-vcgh"
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.103871 22623 fs_report.cc:389] FS layout report
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data/data
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:55.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:55.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.121 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:55.121 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:55.122 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:55.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:55.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:55.122 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:55.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:55.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:55.122 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:55.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:55.122 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:55.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:55.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.151554 22623 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:55.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.153187 22623 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:55.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.153625 22623 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:55.162 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512955161 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:55.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.169 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:15:55.173 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:15:55.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.230149 22623 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.188:40821
12:15:55.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.230254 22703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.188:40821 every 8 connection(s)
12:15:55.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.233060 22623 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/data/info.pb
12:15:55.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.237424 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22623
12:15:55.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.237937 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/master-2/wal/instance
12:15:55.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.239802 22704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:15:55.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.255214 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } has no permanent_uuid. Determining permanent_uuid...
12:15:55.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.280800 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } has no permanent_uuid. Determining permanent_uuid...
12:15:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.291134 22704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } has no permanent_uuid. Determining permanent_uuid...
12:15:55.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.307606 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: Bootstrap starting.
12:15:55.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.314812 22704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: Neither blocks nor log segments found. Creating new log.
12:15:55.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.316665 22704 log.cc:826] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: Log is configured to *not* fsync() on all Append() calls
12:15:55.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.318936 22621 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 7
12:15:55.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.323031 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: No bootstrap required, opened a new log
12:15:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.343138 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: Bootstrap starting.
12:15:55.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.348548 22704 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.349401 22704 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:55.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.349682 22704 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a4245333f34618846b0a3b8d94c7c1, State: Initialized, Role: FOLLOWER
12:15:55.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.350695 22704 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.353916 22714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.354833 22714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.355625 22704 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: configured and running, proceeding with master startup.
12:15:55.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.356182 22621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: Neither blocks nor log segments found. Creating new log.
12:15:55.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.358587 22621 log.cc:826] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: Log is configured to *not* fsync() on all Append() calls
12:15:55.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.369211 22621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: No bootstrap required, opened a new log
12:15:55.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.385913 22726 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:55.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.386281 22726 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:55.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.396135 22621 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.396854 22621 raft_consensus.cc:385] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:55.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.397336 22621 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33040064a2cd4217bdd6b46573dd9bcb, State: Initialized, Role: FOLLOWER
12:15:55.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.398181 22621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.405889 22728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.407109 22728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.407684 22621 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: configured and running, proceeding with master startup.
12:15:55.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.408898 22658 tablet.cc:2406] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:55.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.380823 22623 master_runner.cc:187] Error getting master registration for 127.21.224.190:35543: OK, instance_id { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" instance_seqno: 1783512950798049 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:55.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.412273 22623 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.416468 22728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:15:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.417106 22728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.423838 22728 leader_election.cc:290] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28bbd12b88ad4557b35ac7f3e36f018f (127.21.224.190:35543), c5a4245333f34618846b0a3b8d94c7c1 (127.21.224.188:40821)
12:15:55.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.424093 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33040064a2cd4217bdd6b46573dd9bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5a4245333f34618846b0a3b8d94c7c1" is_pre_election: true
12:15:55.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.424993 22679 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33040064a2cd4217bdd6b46573dd9bcb in term 0.
12:15:55.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.428552 22570 leader_election.cc:304] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33040064a2cd4217bdd6b46573dd9bcb, c5a4245333f34618846b0a3b8d94c7c1; no voters: 
12:15:55.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.431563 22728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Leader pre-election won for term 1
12:15:55.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.432453 22728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:15:55.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.433264 22728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 0 FOLLOWER]: Advancing to term 1
12:15:55.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.443796 22728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.448233 22679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33040064a2cd4217bdd6b46573dd9bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5a4245333f34618846b0a3b8d94c7c1"
12:15:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.448828 22679 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 0 FOLLOWER]: Advancing to term 1
12:15:55.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.458374 22679 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33040064a2cd4217bdd6b46573dd9bcb in term 1.
12:15:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.466188 22570 leader_election.cc:304] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33040064a2cd4217bdd6b46573dd9bcb, c5a4245333f34618846b0a3b8d94c7c1; no voters: 
12:15:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.472324 22728 leader_election.cc:290] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [CANDIDATE]: Term 1 election: Requested vote from peers 28bbd12b88ad4557b35ac7f3e36f018f (127.21.224.190:35543), c5a4245333f34618846b0a3b8d94c7c1 (127.21.224.188:40821)
12:15:55.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.473053 22728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 1 FOLLOWER]: Leader election won for term 1
12:15:55.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.474153 22728 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [term 1 LEADER]: Becoming Leader. State: Replica: 33040064a2cd4217bdd6b46573dd9bcb, State: Running, Role: LEADER
12:15:55.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.475030 22728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.480866 22739 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:15:55.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.481693 22739 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:15:55.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.456188 22547 master_runner.cc:187] Error getting master registration for 127.21.224.190:35543: OK, instance_id { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" instance_seqno: 1783512950798049 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:15:55.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.491477 22547 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:15:55.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.497177 22741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33040064a2cd4217bdd6b46573dd9bcb. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.497787 22741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: This master's current role is: LEADER
12:15:55.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.501405 22743 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:15:55.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.508723 22743 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:15:55.522 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:55.522 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:55.522 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:55.523 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.523 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.523 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.523 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.523 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.523 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.523 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.523 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.523 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:55.525 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.533360 22679 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [term 1 FOLLOWER]: Refusing update from remote peer 33040064a2cd4217bdd6b46573dd9bcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.535030 22728 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:55.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.548765 22545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } attempt: 7
12:15:55.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.550457 22575 tablet.cc:2406] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:55.557 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:55.557 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:55.558 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:55.558 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:55.558 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:55.558 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:55.558 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:55.558 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:55.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:55.559 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:55.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:55.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:55.559 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:55.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.562556 22714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33040064a2cd4217bdd6b46573dd9bcb. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.563335 22714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.577289 22741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.577976 22741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: This master's current role is: LEADER
12:15:55.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.579630 22714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.580267 22714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1 [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.582906 22743 catalog_manager.cc:1383] Generated new cluster ID: 4b11205cdf22460eac3a0aafb6e477ae
12:15:55.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.583175 22743 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:15:55.589 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:55.589 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:55.590 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:55.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.590 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:55.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:55.590 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.590 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.590 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:55.590 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:55.592 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:55.592 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:55.592 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:55.593 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:55.593 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:55.593 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:55.593 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:55.593 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:55.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:55.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:55.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:55.593 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:55.593 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:55.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.627853 22743 catalog_manager.cc:1406] Generated new certificate authority record
12:15:55.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.629623 22545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: Bootstrap starting.
12:15:55.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.630319 22743 catalog_manager.cc:1540] Loading token signing keys...
12:15:55.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.655382 22743 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb: Generated new TSK 0
12:15:55.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.655877 22545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: Neither blocks nor log segments found. Creating new log.
12:15:55.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.656870 22743 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:15:55.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.661346 22545 log.cc:826] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: Log is configured to *not* fsync() on all Append() calls
12:15:55.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512955662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:55.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.670 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:55.671 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:15:55.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.675527 22545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: No bootstrap required, opened a new log
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.684383 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:55.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/logs
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data/info.pb
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.129:0
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.129
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.129
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:55.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:55.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.731022 22545 raft_consensus.cc:359] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.732098 22545 raft_consensus.cc:385] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:15:55.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.732426 22545 raft_consensus.cc:740] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28bbd12b88ad4557b35ac7f3e36f018f, State: Initialized, Role: FOLLOWER
12:15:55.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.733448 22545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } }
12:15:55.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.738108 22752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.740483 22752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.743567 22545 sys_catalog.cc:565] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: configured and running, proceeding with master startup.
12:15:55.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.743785 22519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33040064a2cd4217bdd6b46573dd9bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28bbd12b88ad4557b35ac7f3e36f018f"
12:15:55.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.745048 22520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33040064a2cd4217bdd6b46573dd9bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" is_pre_election: true
12:15:55.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.744527 22519 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 0 FOLLOWER]: Advancing to term 1
12:15:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:55.755743 22499 tablet.cc:2406] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:15:55.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.757349 22519 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33040064a2cd4217bdd6b46573dd9bcb in term 1.
12:15:55.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.758940 22518 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [term 1 FOLLOWER]: Refusing update from remote peer 33040064a2cd4217bdd6b46573dd9bcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:15:55.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.764511 22728 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:15:55.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:55.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.830644 22752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33040064a2cd4217bdd6b46573dd9bcb. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.831367 22752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.833309 22761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.834213 22761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f [sys.catalog]: This master's current role is: FOLLOWER
12:15:55.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:55.862038 22768 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:15:55.877 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:55.877 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:55.877 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:55.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:55.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:55.878 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:55.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:55.878 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:55.878 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:55.878 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:55.878 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:55.878 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:55.878 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:56.025 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.040 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.040 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.041 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.041 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.041 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.041 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.041 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.041 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.041 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.042 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.042 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:56.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:56.051 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:56.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.052 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.052 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.052 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.052 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.052 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.053 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.053 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.053 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:56.068 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.069 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.069 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.069 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.069 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.069 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.069 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.070 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.070 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.071 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.071 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.071 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.072 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.100 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.100 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.101 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.101 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.101 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.101 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.101 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.146 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:56.147 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:56.147 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:56.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.147 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.147 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.147 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.147 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.147 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.147 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.147 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:56.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512956162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:56.167 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.172 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:15:56.173 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.173 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.173 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.174 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.174 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.174 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.174 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.174 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.174 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.174 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.174 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.175 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:15:56.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.266436 22751 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:56.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.267210 22751 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:56.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.268076 22751 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:56.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.286563 22728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "33040064a2cd4217bdd6b46573dd9bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28bbd12b88ad4557b35ac7f3e36f018f" member_type: VOTER last_known_addr { host: "127.21.224.190" port: 35543 } } peers { permanent_uuid: "33040064a2cd4217bdd6b46573dd9bcb" member_type: VOTER last_known_addr { host: "127.21.224.189" port: 39039 } } peers { permanent_uuid: "c5a4245333f34618846b0a3b8d94c7c1" member_type: VOTER last_known_addr { host: "127.21.224.188" port: 40821 } } }
12:15:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.289222 22728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33040064a2cd4217bdd6b46573dd9bcb [sys.catalog]: This master's current role is: LEADER
12:15:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.345942 22751 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.347303 22751 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.224.129
12:15:56.387 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:56.387 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:56.387 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:56.388 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:56.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:56.388 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:56.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:56.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:56.388 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:56.390 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:56.390 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:56.390 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:56.390 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:56.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.393172 22726 catalog_manager.cc:1295] Loaded cluster ID: 4b11205cdf22460eac3a0aafb6e477ae
12:15:56.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.393482 22726 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: loading cluster ID for follower catalog manager: success
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.401254 22726 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: acquiring CA information for follower catalog manager: success
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.401250 22751 tablet_server_runner.cc:78] Tablet server non-default flags:
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.129:0
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data/info.pb
12:15:56.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.129
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.129
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/logs
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:15:56.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:15:56.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.403831 22751 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:15:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.405977 22751 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:15:56.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.407898 22726 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c5a4245333f34618846b0a3b8d94c7c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:56.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.420601 22777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:56.433 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:56.434 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:56.434 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:56.434 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:56.434 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:56.434 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:56.434 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:56.434 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:56.434 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:56.434 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:56.434 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:56.434 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:56.434 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:56.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.551 [DEBUG - pool-292-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [7ms] received response from server master-127.19.5.124:34641: OK, deferred=null) with no deferred attached!
12:15:56.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.621 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:56.621 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:56.621 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:56.621 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:56.621 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:56.621 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:56.622 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:56.622 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:56.622 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:56.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:56.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:56.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:56.622 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:56.632 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.632 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.632 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.633 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.633 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.633 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.633 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.633 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.633 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.633 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.633 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.633 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.634 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.662 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512956662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:56.668 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:15:56.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:15:56.705 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:56.706 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:56.706 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:56.706 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.706 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.706 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:56.707 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.707 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.707 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:56.707 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.707 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.707 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:56.707 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:56.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:56.873 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:56.873 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:56.873 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:56.873 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:56.874 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:56.874 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.874 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.874 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:56.874 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:56.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.881677 22768 catalog_manager.cc:1295] Loaded cluster ID: 4b11205cdf22460eac3a0aafb6e477ae
12:15:56.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.882128 22768 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: loading cluster ID for follower catalog manager: success
12:15:56.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.935379 22768 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: acquiring CA information for follower catalog manager: success
12:15:56.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:56.955354 22768 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 28bbd12b88ad4557b35ac7f3e36f018f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:15:57.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512957162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:57.165 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:57.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:15:57.201 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:57.201 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:57.202 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:57.202 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:57.202 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:57.202 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:57.202 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:57.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:57.202 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:57.203 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:57.203 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:57.203 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:57.203 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:57.266 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [25ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.266 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30013), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [20ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.266 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [18ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.266 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [23ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.267 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [24ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.267 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [53ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.267 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [48ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.267 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [26ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.267 [DEBUG - pool-294-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.19.223.252:41911, [22ms] received response from server master-127.19.223.252:41911: OK, deferred=null) with no deferred attached!
12:15:57.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:57.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:57.531 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:57.531 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.531 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.532 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.532 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.532 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.531 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.532 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.532 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:57.612 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:57.613 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:57.613 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:57.613 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:57.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:57.613 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:57.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:57.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:57.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:57.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:57.614 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:57.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:57.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:57.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512957662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:57.666 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.670 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:57.670 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:57.670 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:57.671 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:15:57.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.672 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.672 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:57.672 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:57.672 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
12:15:57.672 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.672 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.672 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:57.672 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:57.766 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:57.766 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:57.766 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:57.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:57.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:57.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:57.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:57.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:57.767 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:57.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:57.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:57.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:57.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:57.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:57.854 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:57.854 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:57.854 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:57.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:57.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:57.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:57.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:57.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:57.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:57.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:57.855 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:57.855 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:57.855 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:58.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512958162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:58.166 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:15:58.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
12:15:58.275 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.410 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:58.410 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:58.410 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:58.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:58.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:58.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:58.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:58.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:58.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:58.412 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:58.412 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:58.412 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:58.412 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:56.426038 22778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:57.821283 22776 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 22751
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:58.461090 22776 kernel_stack_watchdog.cc:198] Thread 22751 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 392ms:
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:15:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:15:58.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:58.465871 22751 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.039s	user 0.000s	sys 0.001s
12:15:58.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:58.466223 22751 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.039s	user 0.000s	sys 0.002s
12:15:58.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:58.468261 22780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:15:58.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.478907 22751 server_base.cc:1061] running on GCE node
12:15:58.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.480293 22751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:15:58.481 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:58.481 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:58.481 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:58.481 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.481 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.481 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.481 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.481 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.481 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.482 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.482 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.482 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.482 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:58.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.485661 22751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:15:58.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.495539 22751 hybrid_clock.cc:648] HybridClock initialized: now 1783512958495430 us; error 49 us; skew 500 ppm
12:15:58.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.496726 22751 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:15:58.524 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.526093 22751 webserver.cc:533] Webserver started at http://127.21.224.129:43523/ using document root <none> and password file <none>
12:15:58.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.527932 22751 fs_manager.cc:362] Metadata directory not provided
12:15:58.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.528290 22751 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:15:58.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.528954 22751 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:15:58.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.536795 22751 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data/instance:
12:15:58.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47c08d351c2d48108b4850a050167e82"
12:15:58.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:58 on dist-test-slave-vcgh"
12:15:58.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.538689 22751 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal/instance:
12:15:58.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47c08d351c2d48108b4850a050167e82"
12:15:58.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:58 on dist-test-slave-vcgh"
12:15:58.557 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:15:58.558 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:15:58.558 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:15:58.558 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:58.558 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:58.558 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:15:58.558 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:58.558 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:58.558 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:15:58.558 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:58.559 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:58.559 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:15:58.559 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:15:58.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.577445 22751 fs_manager.cc:696] Time spent creating directory manager: real 0.038s	user 0.007s	sys 0.003s
12:15:58.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.600471 22791 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:15:58.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.608660 22751 fs_manager.cc:730] Time spent opening block manager: real 0.020s	user 0.001s	sys 0.002s
12:15:58.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.609153 22751 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal
12:15:58.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47c08d351c2d48108b4850a050167e82"
12:15:58.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:15:58 on dist-test-slave-vcgh"
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.609606 22751 fs_report.cc:389] FS layout report
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data/data
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:15:58.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:15:58.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.663 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512958662 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:58.665 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.672 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:15:58.673 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
12:15:58.708 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:58.708 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:58.708 [DEBUG - pool-338-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:58.709 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:58.709 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:58.709 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:58.709 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:58.709 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:58.710 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:58.710 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:58.710 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:58.710 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:58.710 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:58.711 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27559), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [125ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [129ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [200ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [242ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [442ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [722ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [982ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2462ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1469901642(state=PENDING, result=null, callback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820), errback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820)))
12:15:58.712 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:15:58.712 [WARN - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27559), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [125ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [129ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [200ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [242ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [442ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [722ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [982ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2462ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1469901642(state=PENDING, result=null, callback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820), errback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:58.712 [INFO - Source: KuduSource -> Sink: Writer (4/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3).
12:15:58.714 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#3 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
12:15:58.716 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27559), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [89ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [124ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [125ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [129ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [129ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [200ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [242ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [381ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [381ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [442ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [442ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [721ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [722ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [722ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [982ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [982ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2460ms] refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2461ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2462ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1469901642(state=PENDING, result=null, callback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820), errback=(continuation of Deferred@1705958947 after retry RPC after error@2098176845) -> (continuation of Deferred@1663012565 after retry RPC after error@1407840071) -> (continuation of Deferred@1076194527 after retry RPC after error@1085323869) -> (continuation of Deferred@1606872504 after retry RPC after error@1137291984) -> (continuation of Deferred@685862370 after retry RPC after error@1841715441) -> (continuation of Deferred@92656604 after retry RPC after error@198487694) -> (continuation of Deferred@679038059 after retry RPC after error@1999079493) -> (continuation of Deferred@1553448526 after retry RPC after error@1914293132) -> (continuation of Deferred@274844592 after retry RPC after error@1540295769) -> (continuation of Deferred@978042016 after retry RPC after error@112350670) -> (continuation of Deferred@412103395 after retry RPC after error@1000228972) -> (continuation of Deferred@1549229315 after retry RPC after error@1214213986) -> (continuation of Deferred@1363233696 after retry RPC after error@408270028) -> (continuation of Deferred@2114739584 after retry RPC after error@1302006108) -> (continuation of Deferred@383534852 after retry RPC after error@588935879) -> (continuation of Deferred@1072094073 after retry RPC after error@706933808) -> (continuation of Deferred@1588748823 after retry RPC after error@776912716) -> (continuation of Deferred@670729455 after retry RPC after error@449083220) -> (continuation of Deferred@1462443201 after retry RPC after error@205811127) -> (continuation of Deferred@2137673004 after retry RPC after error@1185807170) -> (continuation of Deferred@1240410690 after retry RPC after error@1726598941) -> (continuation of Deferred@1263009217 after retry RPC after error@1645832192) -> (continuation of Deferred@1377100603 after retry RPC after error@2049789763) -> (continuation of Deferred@250616882 after retry RPC after error@654322820)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:58.717 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:58.717 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#3) of source Source: KuduSource.
12:15:58.717 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_3.
12:15:58.717 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RUNNING to RESTARTING.
12:15:58.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.736805 22751 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:15:58.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.740254 22751 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:15:58.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.740871 22751 kserver.cc:163] Server-wide thread pool size limit: 3276
12:15:58.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.750929 22751 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:15:58.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.763758 22751 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:15:58.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.764133 22751 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
12:15:58.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.764428 22751 ts_tablet_manager.cc:616] Registered 0 tablets
12:15:58.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:58.764631 22751 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:15:58.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:58.833 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:58.833 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:58.834 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:58.834 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.834 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.834 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:58.834 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:58.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:58.835 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:59.024 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:59.060 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:59.061 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:59.061 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:59.061 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.061 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.061 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.062 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.062 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.062 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.062 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.062 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.062 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.062 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:59.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.129446 22751 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.129:35357
12:15:59.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.129571 22904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.129:35357 every 8 connection(s)
12:15:59.130 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:59.130 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:59.130 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:59.130 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.130 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.130 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.131 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:59.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.132951 22751 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/data/info.pb
12:15:59.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.141485 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22751
12:15:59.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.142117 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-0/wal/instance
12:15:59.163 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512959162 for job 5273b45840e0da6e6ca30141a2a11dd8.
12:15:59.170 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 5273b45840e0da6e6ca30141a2a11dd8 (964 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.166113 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/logs
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data/info.pb
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:15:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.130:0
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.130
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.130
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:15:59.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:15:59.171 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
12:15:59.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.237825 22912 heartbeater.cc:344] Connected to a master server at 127.21.224.190:35543
12:15:59.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.238340 22912 heartbeater.cc:461] Registering TS with master...
12:15:59.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.239791 22912 heartbeater.cc:507] Master 127.21.224.190:35543 requested a full tablet report, sending...
12:15:59.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.243711 22510 ts_manager.cc:194] Registered new tserver with Master: 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357)
12:15:59.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.248622 22905 heartbeater.cc:344] Connected to a master server at 127.21.224.188:40821
12:15:59.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.249063 22905 heartbeater.cc:461] Registering TS with master...
12:15:59.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.250020 22905 heartbeater.cc:507] Master 127.21.224.188:40821 requested a full tablet report, sending...
12:15:59.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.253146 22669 ts_manager.cc:194] Registered new tserver with Master: 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357)
12:15:59.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.261548 22906 heartbeater.cc:344] Connected to a master server at 127.21.224.189:39039
12:15:59.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.261909 22906 heartbeater.cc:461] Registering TS with master...
12:15:59.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.262768 22906 heartbeater.cc:507] Master 127.21.224.189:39039 requested a full tablet report, sending...
12:15:59.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.265817 22586 ts_manager.cc:194] Registered new tserver with Master: 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357)
12:15:59.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:15:59.269420 22586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.224.129:56629
12:15:59.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:59.287 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:59.287 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:59.287 [DEBUG - pool-326-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:59.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.289 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.289 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:59.289 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28437), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [66ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [89ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [126ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [127ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [145ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [205ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [205ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [266ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [267ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1621ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2580ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3920ms] refreshing cache from master, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3921ms] too many traces: truncated at 100 traces, deferred=Deferred@2081847688(state=PENDING, result=null, callback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071), errback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071)))
12:15:59.291 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.291 [WARN - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28437), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [66ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [89ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [126ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [127ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [145ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [205ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [205ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [266ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [267ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1621ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2580ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3920ms] refreshing cache from master, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3921ms] too many traces: truncated at 100 traces, deferred=Deferred@2081847688(state=PENDING, result=null, callback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071), errback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.291 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5).
12:15:59.294 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#5 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
12:15:59.296 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28437), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [66ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [67ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [89ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [103ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [103ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [126ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [126ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [127ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [127ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [144ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [145ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [145ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [203ms] refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [205ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [205ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [263ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [266ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [267ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [441ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1621ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2580ms] refreshing cache from master, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3920ms] refreshing cache from master, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3921ms] too many traces: truncated at 100 traces, deferred=Deferred@2081847688(state=PENDING, result=null, callback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071), errback=(continuation of Deferred@574191228 after retry RPC after error@1390903864) -> (continuation of Deferred@999455230 after retry RPC after error@1955040573) -> (continuation of Deferred@493133639 after retry RPC after error@1937516689) -> (continuation of Deferred@1527374473 after retry RPC after error@330265264) -> (continuation of Deferred@705190181 after retry RPC after error@941806677) -> (continuation of Deferred@749433970 after retry RPC after error@1148828069) -> (continuation of Deferred@743444862 after retry RPC after error@41871581) -> (continuation of Deferred@1963004932 after retry RPC after error@2092707728) -> (continuation of Deferred@1355483800 after retry RPC after error@629553244) -> (continuation of Deferred@1490725340 after retry RPC after error@1158143480) -> (continuation of Deferred@1301319690 after retry RPC after error@1505760572) -> (continuation of Deferred@1415173009 after retry RPC after error@793394431) -> (continuation of Deferred@1712581084 after retry RPC after error@1067678167) -> (continuation of Deferred@628945129 after retry RPC after error@1538231677) -> (continuation of Deferred@571196125 after retry RPC after error@113404554) -> (continuation of Deferred@1148926211 after retry RPC after error@1662550164) -> (continuation of Deferred@528071424 after retry RPC after error@175772767) -> (continuation of Deferred@399808306 after retry RPC after error@812628348) -> (continuation of Deferred@1646044618 after retry RPC after error@949914938) -> (continuation of Deferred@197193756 after retry RPC after error@1177099329) -> (continuation of Deferred@1092404155 after retry RPC after error@229077503) -> (continuation of Deferred@23801927 after retry RPC after error@254734143) -> (continuation of Deferred@671671418 after retry RPC after error@513167373) -> (continuation of Deferred@1177006736 after retry RPC after error@1049164412) -> (continuation of Deferred@1363997411 after retry RPC after error@2113328895) -> (continuation of Deferred@104745187 after retry RPC after error@2140936514) -> (continuation of Deferred@1232152504 after retry RPC after error@41632071)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.297 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:59.298 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#5) of source Source: KuduSource.
12:15:59.298 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_5.
12:15:59.299 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:15:59.332 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:15:59.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:15:59.333 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:15:59.333 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.333 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.333 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:15:59.333 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.333 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.333 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:15:59.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.333 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.333 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:15:59.333 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:15:59.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:15:59.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:15:59.341 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:15:59.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:59.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:59.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:15:59.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:59.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:59.342 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:15:59.343 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:59.343 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:59.343 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:15:59.343 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:15:59.507 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:59.508 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:59.508 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:59.509 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.509 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.509 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.510 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.510 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.510 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.510 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.510 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.510 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.510 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:59.521 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:15:59.522 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:15:59.522 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:15:59.522 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:15:59.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:15:59.522 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.522 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:15:59.523 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:15:59.570 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.570 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.570 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.571 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.571 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.571 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.571 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.571 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.571 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.572 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27102), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [1ms] received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [22ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [62ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [342ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [802ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2562ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4361ms] refreshing cache from master, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [4362ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [6681ms] refreshing cache from master, [6681ms] too many traces: truncated at 100 traces, deferred=Deferred@37904762(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2570d2a0 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396)))
12:15:59.572 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27102), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [1ms] received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [22ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [62ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [342ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [802ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2562ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4361ms] refreshing cache from master, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [4362ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [6681ms] refreshing cache from master, [6681ms] too many traces: truncated at 100 traces, deferred=Deferred@37904762(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2570d2a0 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27102), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [1ms] received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [22ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [62ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [342ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [802ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2562ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4361ms] refreshing cache from master, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [4362ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [6681ms] refreshing cache from master, [6681ms] too many traces: truncated at 100 traces, deferred=Deferred@37904762(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2570d2a0 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.125:34511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.577 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.577 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.577 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.577 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.577 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.577 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.577 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.577 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.577 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.577 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.577 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.578 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27102), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [1ms] received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [22ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [62ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [342ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [802ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2562ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4361ms] refreshing cache from master, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [4362ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [6681ms] refreshing cache from master, [6681ms] too many traces: truncated at 100 traces, deferred=Deferred@37904762(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2570d2a0 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=25, TimeoutTracker(timeout=30000, elapsed=27102), Traces: [0ms] sending RPC to server master-127.19.5.124:34641, [1ms] received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [22ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [22ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [62ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [62ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [342ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [342ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [802ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [802ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2561ms] refreshing cache from master, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2562ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2562ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4361ms] refreshing cache from master, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [4361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [4362ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [4362ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [6681ms] refreshing cache from master, [6681ms] too many traces: truncated at 100 traces, deferred=Deferred@37904762(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$221/0x00007fde3432dee0@2570d2a0 -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396), errback=passthrough -> wakeup thread SourceCoordinator-Source: KuduSource-worker-thread-1 -> (continuation of Deferred@17275747 after retry RPC after error@986359354) -> (continuation of Deferred@731007400 after retry RPC after error@139750312) -> (continuation of Deferred@901064002 after retry RPC after error@1520549560) -> (continuation of Deferred@1665622861 after retry RPC after error@1214598566) -> (continuation of Deferred@1424420573 after retry RPC after error@65392263) -> (continuation of Deferred@1541445821 after retry RPC after error@965404186) -> (continuation of Deferred@1517910000 after retry RPC after error@2009406414) -> (continuation of Deferred@683622651 after retry RPC after error@1181469120) -> (continuation of Deferred@1463611402 after retry RPC after error@142121544) -> (continuation of Deferred@1511172900 after retry RPC after error@1110396015) -> (continuation of Deferred@1923307648 after retry RPC after error@1044719174) -> (continuation of Deferred@1908531489 after retry RPC after error@1236633410) -> (continuation of Deferred@565879212 after retry RPC after error@920310987) -> (continuation of Deferred@1223484376 after retry RPC after error@755429904) -> (continuation of Deferred@1506116061 after retry RPC after error@970554018) -> (continuation of Deferred@369405026 after retry RPC after error@210258624) -> (continuation of Deferred@2033641957 after retry RPC after error@197689355) -> (continuation of Deferred@949766828 after retry RPC after error@1980549429) -> (continuation of Deferred@951807952 after retry RPC after error@2008840212) -> (continuation of Deferred@758089061 after retry RPC after error@1039840404) -> (continuation of Deferred@1591515412 after retry RPC after error@1253320195) -> (continuation of Deferred@459380381 after retry RPC after error@1943527281) -> (continuation of Deferred@1241115686 after retry RPC after error@571887396)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.125:34511
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.578 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:59.579 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state RUNNING to RESTARTING.
12:15:59.579 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
12:15:59.579 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:15:59.579 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:15:59.580 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:15:59.580 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:15:59.580 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
12:15:59.580 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:15:59.580 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:15:59.580 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:15:59.581 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:15:59.581 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:15:59.584 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state TERMINATED
12:15:59.584 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state TERMINATED
12:15:59.584 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state TERMINATED
12:15:59.584 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:59.585 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:15:59.585 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:15:59.585 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:59.586 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:59.586 [DEBUG - pool-322-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:59.586 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.586 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.586 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.586 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.586 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.586 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.586 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.586 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.586 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.586 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:59.587 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [17ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [26ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [75ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [208ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [208ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [245ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [782ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [782ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1601ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2061ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3280ms] refreshing cache from master, [3280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3281ms] too many traces: truncated at 100 traces, deferred=Deferred@1074688756(state=PENDING, result=null, callback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147), errback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147)))
12:15:59.588 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.588 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [17ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [26ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [75ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [208ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [208ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [245ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [782ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [782ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1601ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2061ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3280ms] refreshing cache from master, [3280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3281ms] too many traces: truncated at 100 traces, deferred=Deferred@1074688756(state=PENDING, result=null, callback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147), errback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.588 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
12:15:59.590 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:15:59.591 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=28746), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [17ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [21ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [26ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [26ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [65ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [75ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [81ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [82ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [83ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [208ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [208ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [245ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [361ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [362ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [781ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [782ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [782ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1600ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1601ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2060ms] refreshing cache from master, [2060ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2061ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2061ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3280ms] refreshing cache from master, [3280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3281ms] too many traces: truncated at 100 traces, deferred=Deferred@1074688756(state=PENDING, result=null, callback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147), errback=(continuation of Deferred@1439536034 after retry RPC after error@1948955014) -> (continuation of Deferred@1701727803 after retry RPC after error@1447303600) -> (continuation of Deferred@1865269337 after retry RPC after error@1319824059) -> (continuation of Deferred@1495427779 after retry RPC after error@803037646) -> (continuation of Deferred@787698532 after retry RPC after error@924158771) -> (continuation of Deferred@2108398432 after retry RPC after error@960255498) -> (continuation of Deferred@224414266 after retry RPC after error@372708534) -> (continuation of Deferred@929496459 after retry RPC after error@1815179627) -> (continuation of Deferred@1661978445 after retry RPC after error@1295248702) -> (continuation of Deferred@1304021942 after retry RPC after error@711217475) -> (continuation of Deferred@936169197 after retry RPC after error@1698996023) -> (continuation of Deferred@1713572946 after retry RPC after error@1858451356) -> (continuation of Deferred@1068480271 after retry RPC after error@2119379690) -> (continuation of Deferred@15530222 after retry RPC after error@1129760312) -> (continuation of Deferred@16979602 after retry RPC after error@1725982754) -> (continuation of Deferred@19715992 after retry RPC after error@1958655619) -> (continuation of Deferred@1829804288 after retry RPC after error@139746808) -> (continuation of Deferred@1873009533 after retry RPC after error@1856533156) -> (continuation of Deferred@119095016 after retry RPC after error@755505262) -> (continuation of Deferred@1543587457 after retry RPC after error@1896952567) -> (continuation of Deferred@1060224067 after retry RPC after error@1377245347) -> (continuation of Deferred@83130670 after retry RPC after error@2081060301) -> (continuation of Deferred@1315638699 after retry RPC after error@617858757) -> (continuation of Deferred@55174776 after retry RPC after error@750936001) -> (continuation of Deferred@978454951 after retry RPC after error@9246150) -> (continuation of Deferred@1287346569 after retry RPC after error@1924737928) -> (continuation of Deferred@1485577033 after retry RPC after error@809961147)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.592 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.592 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.593 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.593 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.593 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:59.593 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.593 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.593 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
12:15:59.594 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.594 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.594 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.594 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.594 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.594 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.595 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:15:59.601 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:15:59.601 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:15:59.601 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:15:59.604 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state TERMINATED
12:15:59.604 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state TERMINATED
12:15:59.604 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state TERMINATED
12:15:59.606 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:59.606 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:15:59.606 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:15:59.610 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.611 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.611 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.611 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.611 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.611 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.611 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.612 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.612 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.612 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.612 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.613 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:59.613 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:59.613 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:59.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.614 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.614 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.614 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.614 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:59.619 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.619 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:15:59.619 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:15:59.619 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:15:59.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:59.630 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.630 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.630 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.630 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.630 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.630 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.630 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.630 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.631 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.631 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.631 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.631 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.632 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.632 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.633 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:15:59.633 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:15:59.633 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:15:59.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.650 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.651 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.651 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.651 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.651 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.651 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.652 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.652 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.652 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.652 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.657 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:15:59.657 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:15:59.657 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:15:59.664 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state TERMINATED
12:15:59.664 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state TERMINATED
12:15:59.664 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state TERMINATED
12:15:59.664 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:59.664 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:15:59.665 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:15:59.670 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.671 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.671 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.671 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.671 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.671 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.671 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.671 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.672 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.673 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:15:59.673 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:15:59.673 [INFO - flink-pekko.actor.default-dispatcher-5] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:15:59.677 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.19.223.253:37033(127.19.223.253:37033)] disconnecting while in state TERMINATED
12:15:59.677 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.19.223.252:41911(127.19.223.252:41911)] disconnecting while in state TERMINATED
12:15:59.678 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer ac51161fda3d472ab4a07ec520f694dc(127.19.223.194:44817)] disconnecting while in state TERMINATED
12:15:59.678 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.19.223.254:42193(127.19.223.254:42193)] disconnecting while in state TERMINATED
12:15:59.678 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:15:59.678 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-0
12:15:59.678 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:15:59.679 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-3
12:15:59.685 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#0 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0.
12:15:59.686 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
12:15:59.686 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CANCELING to CANCELED.
12:15:59.687 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:15:59.688 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:15:59.688 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:15:59.691 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.691 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.692 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.692 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.692 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.692 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.693 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.693 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.693 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.693 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.693 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.693 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.693 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:59.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:59.711 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:59.712 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.712 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.712 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.712 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.713 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.713 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.713 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.713 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:59.723 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.723 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:15:59.725 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:15:59.725 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:15:59.725 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:15:59.726 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:15:59.727 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:59.735 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-2
12:15:59.735 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:15:59.736 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:15:59.736 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:15:59.737 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:15:59.737 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 5273b45840e0da6e6ca30141a2a11dd8
12:15:59.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:15:59.790 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:15:59.791 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:15:59.791 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:15:59.791 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.791 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.791 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:15:59.792 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.792 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.792 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:15:59.792 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.792 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.792 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:15:59.792 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:15:59.891 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:15:59.891 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:15:59.891 [DEBUG - pool-328-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:15:59.891 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.891 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.891 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.891 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:15:59.891 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.891 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:15:59.891 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:15:59.892 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:15:59.892 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29034), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [113ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [198ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [221ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3541ms] refreshing cache from master, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3543ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107)))
12:15:59.894 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.894 [WARN - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29034), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [113ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [198ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [221ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3541ms] refreshing cache from master, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3543ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.895 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5).
12:15:59.896 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#5 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
12:15:59.899 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29034), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [44ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [45ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [46ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [46ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [62ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [68ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [109ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [112ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [113ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [121ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [122ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [122ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [198ms] refreshing cache from master, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [200ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [201ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [202ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [221ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3181ms] refreshing cache from master, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3182ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3182ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3541ms] refreshing cache from master, [3541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3543ms] too many traces: truncated at 100 traces, deferred=Deferred@804398577(state=PENDING, result=null, callback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107), errback=(continuation of Deferred@570212908 after retry RPC after error@2025830808) -> (continuation of Deferred@344773564 after retry RPC after error@720351601) -> (continuation of Deferred@1841691554 after retry RPC after error@1756622075) -> (continuation of Deferred@441504610 after retry RPC after error@1298369888) -> (continuation of Deferred@263812997 after retry RPC after error@2015004349) -> (continuation of Deferred@1682805023 after retry RPC after error@890509435) -> (continuation of Deferred@1901413379 after retry RPC after error@1565920250) -> (continuation of Deferred@1436265510 after retry RPC after error@1088008494) -> (continuation of Deferred@460816490 after retry RPC after error@1989366053) -> (continuation of Deferred@2128685389 after retry RPC after error@1941747582) -> (continuation of Deferred@1416568243 after retry RPC after error@941188194) -> (continuation of Deferred@1338349933 after retry RPC after error@1498726572) -> (continuation of Deferred@1970982064 after retry RPC after error@104045577) -> (continuation of Deferred@1709077331 after retry RPC after error@443584228) -> (continuation of Deferred@961334870 after retry RPC after error@595975842) -> (continuation of Deferred@894920042 after retry RPC after error@726583946) -> (continuation of Deferred@1957662667 after retry RPC after error@2035429170) -> (continuation of Deferred@2007001415 after retry RPC after error@719845283) -> (continuation of Deferred@582935779 after retry RPC after error@1249735737) -> (continuation of Deferred@1046730336 after retry RPC after error@732718304) -> (continuation of Deferred@2128614538 after retry RPC after error@1595767763) -> (continuation of Deferred@2146268806 after retry RPC after error@934188799) -> (continuation of Deferred@1234469060 after retry RPC after error@2112076230) -> (continuation of Deferred@1773054394 after retry RPC after error@712299294) -> (continuation of Deferred@1200354356 after retry RPC after error@667306122) -> (continuation of Deferred@993642161 after retry RPC after error@936976107)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.900 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#5) of source Source: KuduSource.
12:15:59.900 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:15:59.910 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_5.
12:15:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:59.940593 22916 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:15:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:59.941254 22916 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:15:59.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:59.942031 22916 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:15:59.947 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:59.947 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:59.947 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:59.948 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.948 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.948 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.948 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.948 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.948 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.949 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:59.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29096), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [71ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [71ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [146ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [146ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [206ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [207ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [209ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [209ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [244ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [309ms] refreshing cache from master, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [311ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [312ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [317ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [317ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [542ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1403ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [3661ms] refreshing cache from master, [3661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3663ms] too many traces: truncated at 100 traces, deferred=Deferred@1261702381(state=PENDING, result=null, callback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040), errback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040)))
12:15:59.950 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:59.950 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:59.950 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:59.950 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29096), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [71ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [71ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [146ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [146ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [206ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [207ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [209ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [209ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [244ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [309ms] refreshing cache from master, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [311ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [312ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [317ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [317ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [542ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1403ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [3661ms] refreshing cache from master, [3661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3663ms] too many traces: truncated at 100 traces, deferred=Deferred@1261702381(state=PENDING, result=null, callback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040), errback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29096), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [71ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [71ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [146ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [146ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [206ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [207ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [209ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [209ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [244ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [309ms] refreshing cache from master, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [311ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [312ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [317ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [317ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [542ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1403ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [3661ms] refreshing cache from master, [3661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3663ms] too many traces: truncated at 100 traces, deferred=Deferred@1261702381(state=PENDING, result=null, callback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040), errback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.252:39469
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.950 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.950 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.950 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.951 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.951 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.951 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.951 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:59.969 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:15:59.969 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:15:59.969 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:15:59.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:15:59.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:15:59.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.970 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.970 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:15:59.970 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:15:59.969 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:59.971 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:59.971 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:59.971 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.971 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.971 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.971 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.971 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.971 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.971 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.972 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.972 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.972 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:59.975 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29096), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [71ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [71ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [146ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [146ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [206ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [207ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [209ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [209ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [244ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [309ms] refreshing cache from master, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [311ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [312ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [317ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [317ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [542ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1403ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [3661ms] refreshing cache from master, [3661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3663ms] too many traces: truncated at 100 traces, deferred=Deferred@1261702381(state=PENDING, result=null, callback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040), errback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30, TimeoutTracker(timeout=30000, elapsed=29096), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [59ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [71ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [71ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [128ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [129ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [130ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [130ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [145ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [146ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [146ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [162ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [162ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [205ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [206ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [207ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [209ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [209ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [242ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [243ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [244ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [244ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [309ms] refreshing cache from master, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [311ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [312ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [317ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [317ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [401ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [402ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [542ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [542ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [661ms] refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [662ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [662ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1401ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1403ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1581ms] refreshing cache from master, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1582ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1582ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [3661ms] refreshing cache from master, [3661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [3662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [3663ms] too many traces: truncated at 100 traces, deferred=Deferred@1261702381(state=PENDING, result=null, callback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040), errback=(continuation of Deferred@713337305 after retry RPC after error@1648854079) -> (continuation of Deferred@1703255512 after retry RPC after error@247314145) -> (continuation of Deferred@24644750 after retry RPC after error@1598031586) -> (continuation of Deferred@383921039 after retry RPC after error@1972083980) -> (continuation of Deferred@886502223 after retry RPC after error@1803457569) -> (continuation of Deferred@1825006738 after retry RPC after error@1166927867) -> (continuation of Deferred@1178744974 after retry RPC after error@1501721595) -> (continuation of Deferred@246837165 after retry RPC after error@615445439) -> (continuation of Deferred@1937717740 after retry RPC after error@958955987) -> (continuation of Deferred@81676892 after retry RPC after error@1472098931) -> (continuation of Deferred@1568969009 after retry RPC after error@551531851) -> (continuation of Deferred@1453688742 after retry RPC after error@1915505387) -> (continuation of Deferred@198721670 after retry RPC after error@1458624859) -> (continuation of Deferred@739441812 after retry RPC after error@1022988527) -> (continuation of Deferred@1978411910 after retry RPC after error@621157985) -> (continuation of Deferred@508272649 after retry RPC after error@1850029511) -> (continuation of Deferred@2061603730 after retry RPC after error@1870757817) -> (continuation of Deferred@747225512 after retry RPC after error@1797599987) -> (continuation of Deferred@489574662 after retry RPC after error@2042005933) -> (continuation of Deferred@466650034 after retry RPC after error@1503692945) -> (continuation of Deferred@921257154 after retry RPC after error@2078230611) -> (continuation of Deferred@1678612873 after retry RPC after error@968126873) -> (continuation of Deferred@1166535993 after retry RPC after error@1151055882) -> (continuation of Deferred@1280483521 after retry RPC after error@1458579563) -> (continuation of Deferred@753203625 after retry RPC after error@891703255) -> (continuation of Deferred@1823188250 after retry RPC after error@995060628) -> (continuation of Deferred@812512485 after retry RPC after error@934436296) -> (continuation of Deferred@100711761 after retry RPC after error@1179874766) -> (continuation of Deferred@432438077 after retry RPC after error@1019161040)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.252:39469
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:15:59.975 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:15:59.975 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#5) of source Source: KuduSource.
12:15:59.976 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
12:15:59.976 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:59.976 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from INITIALIZING to CANCELING.
12:15:59.976 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:59.978 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:15:59.978 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
12:15:59.978 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5).
12:15:59.979 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#5 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5.
12:15:59.979 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CANCELING to CANCELED.
12:15:59.980 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:15:59.987 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:15:59.987 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:15:59.987 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:15:59.988 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.988 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.988 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:15:59.988 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.988 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.988 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:15:59.988 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.988 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.988 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:15:59.988 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:15:59.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:59.997453 22916 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:15:59.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:15:59.998611 22916 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.224.130
12:16:00.007 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.007 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.007 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.010 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.010 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.010 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.010 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.020 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.020 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.021 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.021 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.021 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.021 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.021 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.021 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.021 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.022 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.022 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.022 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.022 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.022 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [93ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [157ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [172ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [173ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [184ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [241ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [522ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1082ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1962ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4241ms] refreshing cache from master, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4242ms] too many traces: truncated at 100 traces, deferred=Deferred@1767318668(state=PENDING, result=null, callback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308), errback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308)))
12:16:00.023 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.023 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.023 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.023 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.023 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.023 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.023 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [93ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [157ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [172ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [173ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [184ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [241ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [522ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1082ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1962ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4241ms] refreshing cache from master, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4242ms] too many traces: truncated at 100 traces, deferred=Deferred@1767318668(state=PENDING, result=null, callback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308), errback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [93ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [157ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [172ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [173ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [184ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [241ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [522ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1082ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1962ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4241ms] refreshing cache from master, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4242ms] too many traces: truncated at 100 traces, deferred=Deferred@1767318668(state=PENDING, result=null, callback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308), errback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:00.024 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.024 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.024 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.024 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.027 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:00.027 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:00.027 [DEBUG - pool-324-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:00.028 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:00.028 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:00.028 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:00.028 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:00.028 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:00.028 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:00.028 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:00.028 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:00.028 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:00.028 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:00.029 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [68ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [75ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [76ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [76ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [84ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [88ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [89ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [89ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [124ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [125ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [126ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [126ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [142ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [143ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [143ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [161ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [162ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [202ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [204ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [205ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [208ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [208ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [221ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [222ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [222ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [242ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [242ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [421ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [422ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [482ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1461ms] refreshing cache from master, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1461ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1462ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1462ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1700ms] refreshing cache from master, [1700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1701ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1701ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2682ms] too many traces: truncated at 100 traces, deferred=Deferred@1644571423(state=PENDING, result=null, callback=(continuation of Deferred@895998388 after retry RPC after error@171482674) -> (continuation of Deferred@272914947 after retry RPC after error@1128908231) -> (continuation of Deferred@1214778979 after retry RPC after error@107987026) -> (continuation of Deferred@877201118 after retry RPC after error@967023213) -> (continuation of Deferred@833650732 after retry RPC after error@1227205400) -> (continuation of Deferred@891693844 after retry RPC after error@284405551) -> (continuation of Deferred@628616445 after retry RPC after error@1097788960) -> (continuation of Deferred@1158939538 after retry RPC after error@1217611464) -> (continuation of Deferred@1385777955 after retry RPC after error@1680908478) -> (continuation of Deferred@22886201 after retry RPC after error@1403688156) -> (continuation of Deferred@1265765849 after retry RPC after error@715546969) -> (continuation of Deferred@1118465995 after retry RPC after error@1168187190) -> (continuation of Deferred@510054046 after retry RPC after error@122935458) -> (continuation of Deferred@378944436 after retry RPC after error@1535364863) -> (continuation of Deferred@1933175087 after retry RPC after error@1781967138) -> (continuation of Deferred@1306162251 after retry RPC after error@141274937) -> (continuation of Deferred@874995594 after retry RPC after error@1804046229) -> (continuation of Deferred@1977734786 after retry RPC after error@539405664) -> (continuation of Deferred@779316705 after retry RPC after error@2044703901) -> (continuation of Deferred@49359074 after retry RPC after error@388614257) -> (continuation of Deferred@578855696 after retry RPC after error@645890177) -> (continuation of Deferred@759306900 after retry RPC after error@1961964813) -> (continuation of Deferred@1397657760 after retry RPC after error@158300608) -> (continuation of Deferred@885277891 after retry RPC after error@1239438859) -> (continuation of Deferred@1854673927 after retry RPC after error@484426095), errback=(continuation of Deferred@895998388 after retry RPC after error@171482674) -> (continuation of Deferred@272914947 after retry RPC after error@1128908231) -> (continuation of Deferred@1214778979 after retry RPC after error@107987026) -> (continuation of Deferred@877201118 after retry RPC after error@967023213) -> (continuation of Deferred@833650732 after retry RPC after error@1227205400) -> (continuation of Deferred@891693844 after retry RPC after error@284405551) -> (continuation of Deferred@628616445 after retry RPC after error@1097788960) -> (continuation of Deferred@1158939538 after retry RPC after error@1217611464) -> (continuation of Deferred@1385777955 after retry RPC after error@1680908478) -> (continuation of Deferred@22886201 after retry RPC after error@1403688156) -> (continuation of Deferred@1265765849 after retry RPC after error@715546969) -> (continuation of Deferred@1118465995 after retry RPC after error@1168187190) -> (continuation of Deferred@510054046 after retry RPC after error@122935458) -> (continuation of Deferred@378944436 after retry RPC after error@1535364863) -> (continuation of Deferred@1933175087 after retry RPC after error@1781967138) -> (continuation of Deferred@1306162251 after retry RPC after error@141274937) -> (continuation of Deferred@874995594 after retry RPC after error@1804046229) -> (continuation of Deferred@1977734786 after retry RPC after error@539405664) -> (continuation of Deferred@779316705 after retry RPC after error@2044703901) -> (continuation of Deferred@49359074 after retry RPC after error@388614257) -> (continuation of Deferred@578855696 after retry RPC after error@645890177) -> (continuation of Deferred@759306900 after retry RPC after error@1961964813) -> (continuation of Deferred@1397657760 after retry RPC after error@158300608) -> (continuation of Deferred@885277891 after retry RPC after error@1239438859) -> (continuation of Deferred@1854673927 after retry RPC after error@484426095)))
12:16:00.030 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.030 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.030 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.030 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.030 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.030 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.030 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.030 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.030 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.030 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.030 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.030 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.030 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.031 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.031 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.031 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.031 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.031 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.031 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.031 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.031 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.031 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.031 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.031 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.032 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [93ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [157ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [172ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [173ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [184ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [241ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [522ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1082ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1962ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4241ms] refreshing cache from master, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4242ms] too many traces: truncated at 100 traces, deferred=Deferred@1767318668(state=PENDING, result=null, callback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308), errback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28881), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [41ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [92ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [93ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [93ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [156ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [157ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [160ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [172ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [173ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [182ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [183ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [184ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [184ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [221ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [222ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [241ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [241ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [442ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [442ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [521ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [522ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [522ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [801ms] refreshing cache from master, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [802ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [802ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1082ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1961ms] refreshing cache from master, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1962ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1962ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [4241ms] refreshing cache from master, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [4241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [4242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4242ms] too many traces: truncated at 100 traces, deferred=Deferred@1767318668(state=PENDING, result=null, callback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308), errback=(continuation of Deferred@1218076468 after retry RPC after error@1797589029) -> (continuation of Deferred@1864636097 after retry RPC after error@1065827565) -> (continuation of Deferred@637446102 after retry RPC after error@1717167980) -> (continuation of Deferred@688158584 after retry RPC after error@794969825) -> (continuation of Deferred@2138215628 after retry RPC after error@1446604489) -> (continuation of Deferred@1552710849 after retry RPC after error@1642364159) -> (continuation of Deferred@173752571 after retry RPC after error@386480223) -> (continuation of Deferred@685519883 after retry RPC after error@1780332139) -> (continuation of Deferred@974221131 after retry RPC after error@1678013334) -> (continuation of Deferred@766603121 after retry RPC after error@706230850) -> (continuation of Deferred@457339773 after retry RPC after error@1553808192) -> (continuation of Deferred@2054229317 after retry RPC after error@298906211) -> (continuation of Deferred@427926207 after retry RPC after error@754179572) -> (continuation of Deferred@1587209738 after retry RPC after error@1221542992) -> (continuation of Deferred@1548714924 after retry RPC after error@1860299180) -> (continuation of Deferred@1740826828 after retry RPC after error@1428016544) -> (continuation of Deferred@1970239052 after retry RPC after error@337796548) -> (continuation of Deferred@1691763460 after retry RPC after error@1595794163) -> (continuation of Deferred@1372463690 after retry RPC after error@1468307914) -> (continuation of Deferred@18624093 after retry RPC after error@832982775) -> (continuation of Deferred@291170043 after retry RPC after error@1659070419) -> (continuation of Deferred@49140500 after retry RPC after error@20964424) -> (continuation of Deferred@1200924586 after retry RPC after error@1051757940) -> (continuation of Deferred@1378458821 after retry RPC after error@743059308)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.125:46113
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:00.033 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:00.033 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#3) of source Source: KuduSource.
12:16:00.033 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
12:16:00.034 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
12:16:00.034 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from INITIALIZING to CANCELING.
12:16:00.034 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
12:16:00.034 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
12:16:00.034 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:16:00.034 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
12:16:00.034 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:16:00.035 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:16:00.035 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
12:16:00.035 [INFO - Source: KuduSource -> Sink: Writer (3/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3).
12:16:00.036 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:16:00.036 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to CANCELING.
12:16:00.037 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:16:00.041 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.041 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.041 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.041 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.041 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.041 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.042 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.042 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.042 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.042 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.042 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.044 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:16:00.044 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to CANCELING.
12:16:00.044 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:16:00.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:16:00.045 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#3 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3.
12:16:00.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:16:00.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:16:00.045 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
12:16:00.046 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_3) switched from CANCELING to CANCELED.
12:16:00.046 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:16:00.046 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:16:00.046 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:16:00.047 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CANCELING to CANCELED.
12:16:00.048 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
12:16:00.050 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CANCELING to CANCELED.
12:16:00.048 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:00.053 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:00.053 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c0988648dfcd43275159a42b4d64d13e
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:00.057150 22916 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.130:0
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data/info.pb
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.130
12:16:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.130
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/logs
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:00.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:00.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:00.059010 22916 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:00.060 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.061 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.061 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.061 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.061 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.061 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.062 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.062 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.062 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.062 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.062 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.062 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:00.060892 22916 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:00.067 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.067 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.067 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.068 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.068 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.068 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.068 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.068 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.068 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.071 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.071 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.071 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.071 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.081 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.081 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.081 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.082 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.082 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.082 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.082 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.082 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.082 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.082 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.082 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.082 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.101 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.101 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.101 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.102 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.102 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.102 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.102 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.103 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.103 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.107 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.107 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.107 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.108 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.108 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.108 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.108 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.108 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.108 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.108 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.108 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.108 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.109 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:00.121 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.121 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.121 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.121 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.121 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.121 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.122 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.122 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.122 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.122 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.122 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.122 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.122 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:00.123993 22955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:00.181 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.182 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.182 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.182 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.182 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.182 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.183 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.183 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.183 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.183 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.183 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.183 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.183 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:00.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:00.193 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:00.194 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.194 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.194 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.194 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.194 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.194 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.194 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.194 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.194 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.194 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:00.207 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.207 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.207 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.207 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.207 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.207 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.208 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.208 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.207 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.208 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.208 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.208 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.208 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.214 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:00.214 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:00.214 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:00.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:00.214 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:00.214 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:00.215 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:00.215 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:00.215 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:00.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:00.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:00.215 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:00.215 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:00.229 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:00.229 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:00.229 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:00.230 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:00.230 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:00.230 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:00.230 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:00.230 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:00.230 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:00.231 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:00.231 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:00.231 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:00.231 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:00.241 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:00.241 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:00.241 [DEBUG - pool-332-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:00.241 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.241 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.241 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.241 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.241 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.241 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.241 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.241 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.241 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.242 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:00.242 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29128), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [66ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [73ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [74ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [74ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [95ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [96ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [97ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [97ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [103ms] refreshing cache from master, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [115ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [115ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [121ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [240ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [321ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [321ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [421ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [421ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [641ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [641ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [641ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [641ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [920ms] refreshing cache from master, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [920ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [921ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [921ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [921ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [921ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2340ms] refreshing cache from master, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2341ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3800ms] refreshing cache from master, [3801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3802ms] too many traces: truncated at 100 traces, deferred=Deferred@2119433744(state=PENDING, result=null, callback=(continuation of Deferred@499403797 after retry RPC after error@1904297282) -> (continuation of Deferred@39056802 after retry RPC after error@1670461574) -> (continuation of Deferred@1552573445 after retry RPC after error@668635523) -> (continuation of Deferred@976854591 after retry RPC after error@1342625014) -> (continuation of Deferred@1604528319 after retry RPC after error@747039809) -> (continuation of Deferred@1513641864 after retry RPC after error@1014991197) -> (continuation of Deferred@2053093565 after retry RPC after error@1629529939) -> (continuation of Deferred@2042378472 after retry RPC after error@961111011) -> (continuation of Deferred@1054129703 after retry RPC after error@1521126545) -> (continuation of Deferred@1112118356 after retry RPC after error@820883845) -> (continuation of Deferred@735249465 after retry RPC after error@630447062) -> (continuation of Deferred@729153540 after retry RPC after error@1993014646) -> (continuation of Deferred@1158405466 after retry RPC after error@2130568006) -> (continuation of Deferred@1695595197 after retry RPC after error@1150339620) -> (continuation of Deferred@1609182945 after retry RPC after error@1318846857) -> (continuation of Deferred@775528373 after retry RPC after error@1815785916) -> (continuation of Deferred@1646860284 after retry RPC after error@1276625529) -> (continuation of Deferred@774973561 after retry RPC after error@398445394) -> (continuation of Deferred@1023649966 after retry RPC after error@1333109117) -> (continuation of Deferred@1755331082 after retry RPC after error@28088599) -> (continuation of Deferred@566888276 after retry RPC after error@1129722969) -> (continuation of Deferred@718222931 after retry RPC after error@1338930748) -> (continuation of Deferred@1045375030 after retry RPC after error@1288251226) -> (continuation of Deferred@535297342 after retry RPC after error@597956456) -> (continuation of Deferred@1693287858 after retry RPC after error@1629195650) -> (continuation of Deferred@1094025874 after retry RPC after error@1110033035), errback=(continuation of Deferred@499403797 after retry RPC after error@1904297282) -> (continuation of Deferred@39056802 after retry RPC after error@1670461574) -> (continuation of Deferred@1552573445 after retry RPC after error@668635523) -> (continuation of Deferred@976854591 after retry RPC after error@1342625014) -> (continuation of Deferred@1604528319 after retry RPC after error@747039809) -> (continuation of Deferred@1513641864 after retry RPC after error@1014991197) -> (continuation of Deferred@2053093565 after retry RPC after error@1629529939) -> (continuation of Deferred@2042378472 after retry RPC after error@961111011) -> (continuation of Deferred@1054129703 after retry RPC after error@1521126545) -> (continuation of Deferred@1112118356 after retry RPC after error@820883845) -> (continuation of Deferred@735249465 after retry RPC after error@630447062) -> (continuation of Deferred@729153540 after retry RPC after error@1993014646) -> (continuation of Deferred@1158405466 after retry RPC after error@2130568006) -> (continuation of Deferred@1695595197 after retry RPC after error@1150339620) -> (continuation of Deferred@1609182945 after retry RPC after error@1318846857) -> (continuation of Deferred@775528373 after retry RPC after error@1815785916) -> (continuation of Deferred@1646860284 after retry RPC after error@1276625529) -> (continuation of Deferred@774973561 after retry RPC after error@398445394) -> (continuation of Deferred@1023649966 after retry RPC after error@1333109117) -> (continuation of Deferred@1755331082 after retry RPC after error@28088599) -> (continuation of Deferred@566888276 after retry RPC after error@1129722969) -> (continuation of Deferred@718222931 after retry RPC after error@1338930748) -> (continuation of Deferred@1045375030 after retry RPC after error@1288251226) -> (continuation of Deferred@535297342 after retry RPC after error@597956456) -> (continuation of Deferred@1693287858 after retry RPC after error@1629195650) -> (continuation of Deferred@1094025874 after retry RPC after error@1110033035)))
12:16:00.270 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.270 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.271 [DEBUG - pool-292-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.271 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.271 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.271 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.272 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.272 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.272 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.272 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.272 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:00.274202 22906 heartbeater.cc:499] Master 127.21.224.189:39039 was elected leader, sending a full tablet report...
12:16:00.276 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:00.301 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.301 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.301 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.302 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.302 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.302 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.302 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.302 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.302 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.302 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.302 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.302 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.303 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.467 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.468 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.468 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.468 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.468 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.468 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.469 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.469 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.469 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.469 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.469 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.522 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:00.522 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:00.522 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:00.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:00.523 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.523 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:00.523 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.523 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.523 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:00.523 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:00.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:00.652 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state RESTARTING to RUNNING.
12:16:00.653 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 5273b45840e0da6e6ca30141a2a11dd8 from Checkpoint 65 @ 1783512959162 for 5273b45840e0da6e6ca30141a2a11dd8 located at file:/tmp/junit2392792015498175258/checkpoints/5273b45840e0da6e6ca30141a2a11dd8/chk-65.
12:16:00.653 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
12:16:00.654 [INFO - flink-pekko.actor.default-dispatcher-9] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:00.654 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:16:00.655 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:00.656 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:16:00.656 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id da2c643a0e0cd56e531ac7783f030706
12:16:00.657 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to SCHEDULED.
12:16:00.657 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot da2c643a0e0cd56e531ac7783f030706.
12:16:00.658 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id da2c643a0e0cd56e531ac7783f030706.
12:16:00.659 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:00.660 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from SCHEDULED to DEPLOYING.
12:16:00.660 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #1) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id b54796e71d0c583e2956576d9a50fdec
12:16:00.662 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to SCHEDULED.
12:16:00.663 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:00.664 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from SCHEDULED to DEPLOYING.
12:16:00.664 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #1) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id 11655f63c26cfc770969daf002dc4f10
12:16:00.664 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to SCHEDULED.
12:16:00.665 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:00.665 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot b54796e71d0c583e2956576d9a50fdec.
12:16:00.666 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from SCHEDULED to DEPLOYING.
12:16:00.666 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #1) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id d35a590e069d52f250d74ff29b6a113a
12:16:00.666 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1), deploy into slot with allocation id b54796e71d0c583e2956576d9a50fdec.
12:16:00.666 [INFO - Thread-55] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:00.667 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:16:00.667 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:16:00.667 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.19.5.126:41267(127.19.5.126:41267)] disconnecting while in state TERMINATED
12:16:00.667 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.19.5.124:34641(127.19.5.124:34641)] disconnecting while in state TERMINATED
12:16:00.667 [DEBUG - Thread-55] (Connection.java:575) [peer master-127.19.5.125:34511(127.19.5.125:34511)] disconnecting while in state TERMINATED
12:16:00.668 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:00.668 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 11655f63c26cfc770969daf002dc4f10.
12:16:00.668 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39c5f687
12:16:00.668 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:00.668 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:00.669 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-1
12:16:00.669 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:16:00.669 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:16:00.669 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1), deploy into slot with allocation id 11655f63c26cfc770969daf002dc4f10.
12:16:00.670 [INFO - Thread-55] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:00.670 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CREATED to DEPLOYING.
12:16:00.670 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) [DEPLOYING].
12:16:00.670 [INFO - Thread-55] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:00.672 [DEBUG - Thread-55] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:00.672 [INFO - Thread-55] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:00.672 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:16:00.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:00.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:00.673 [DEBUG - pool-334-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:00.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.673 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.674 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.674 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.674 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.674 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:00.675 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=29527), Traces: [0ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [39ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [46ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [47ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [48ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [77ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [78ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [79ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [79ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [86ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [87ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [93ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [121ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [142ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [261ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [681ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [681ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [681ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [682ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1521ms] refreshing cache from master, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1521ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1522ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2601ms] refreshing cache from master, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2602ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2602ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3960ms] refreshing cache from master, [3960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3961ms] too many traces: truncated at 100 traces, deferred=Deferred@63112153(state=PENDING, result=null, callback=(continuation of Deferred@1024326430 after retry RPC after error@2134271807) -> (continuation of Deferred@1124631372 after retry RPC after error@1481542975) -> (continuation of Deferred@172578851 after retry RPC after error@1183504842) -> (continuation of Deferred@1092559028 after retry RPC after error@1830054621) -> (continuation of Deferred@761052956 after retry RPC after error@1023965172) -> (continuation of Deferred@86698593 after retry RPC after error@1260792475) -> (continuation of Deferred@55236796 after retry RPC after error@2105780470) -> (continuation of Deferred@799550661 after retry RPC after error@1436596569) -> (continuation of Deferred@16389225 after retry RPC after error@1625213080) -> (continuation of Deferred@251534914 after retry RPC after error@1581515957) -> (continuation of Deferred@248322632 after retry RPC after error@406948097) -> (continuation of Deferred@1723041861 after retry RPC after error@405559690) -> (continuation of Deferred@2119507869 after retry RPC after error@1783142615) -> (continuation of Deferred@281265275 after retry RPC after error@1784229856) -> (continuation of Deferred@1009155265 after retry RPC after error@310822322) -> (continuation of Deferred@476588933 after retry RPC after error@1072509383) -> (continuation of Deferred@815956623 after retry RPC after error@346909308) -> (continuation of Deferred@1229217647 after retry RPC after error@527510665) -> (continuation of Deferred@996373266 after retry RPC after error@1155661960) -> (continuation of Deferred@800493660 after retry RPC after error@968225863) -> (continuation of Deferred@426703744 after retry RPC after error@1306283621) -> (continuation of Deferred@1458770930 after retry RPC after error@1089655463) -> (continuation of Deferred@783188930 after retry RPC after error@19812116) -> (continuation of Deferred@1326227520 after retry RPC after error@423437548) -> (continuation of Deferred@1138164890 after retry RPC after error@821212443), errback=(continuation of Deferred@1024326430 after retry RPC after error@2134271807) -> (continuation of Deferred@1124631372 after retry RPC after error@1481542975) -> (continuation of Deferred@172578851 after retry RPC after error@1183504842) -> (continuation of Deferred@1092559028 after retry RPC after error@1830054621) -> (continuation of Deferred@761052956 after retry RPC after error@1023965172) -> (continuation of Deferred@86698593 after retry RPC after error@1260792475) -> (continuation of Deferred@55236796 after retry RPC after error@2105780470) -> (continuation of Deferred@799550661 after retry RPC after error@1436596569) -> (continuation of Deferred@16389225 after retry RPC after error@1625213080) -> (continuation of Deferred@251534914 after retry RPC after error@1581515957) -> (continuation of Deferred@248322632 after retry RPC after error@406948097) -> (continuation of Deferred@1723041861 after retry RPC after error@405559690) -> (continuation of Deferred@2119507869 after retry RPC after error@1783142615) -> (continuation of Deferred@281265275 after retry RPC after error@1784229856) -> (continuation of Deferred@1009155265 after retry RPC after error@310822322) -> (continuation of Deferred@476588933 after retry RPC after error@1072509383) -> (continuation of Deferred@815956623 after retry RPC after error@346909308) -> (continuation of Deferred@1229217647 after retry RPC after error@527510665) -> (continuation of Deferred@996373266 after retry RPC after error@1155661960) -> (continuation of Deferred@800493660 after retry RPC after error@968225863) -> (continuation of Deferred@426703744 after retry RPC after error@1306283621) -> (continuation of Deferred@1458770930 after retry RPC after error@1089655463) -> (continuation of Deferred@783188930 after retry RPC after error@19812116) -> (continuation of Deferred@1326227520 after retry RPC after error@423437548) -> (continuation of Deferred@1138164890 after retry RPC after error@821212443)))
12:16:00.676 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:16:00.676 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7bbcaf51
12:16:00.676 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:00.676 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:00.677 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:16:00.677 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from DEPLOYING to INITIALIZING.
12:16:00.677 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2ed5f858
12:16:00.679 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:00.684 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@612add1f
12:16:00.687 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:00.687 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot d35a590e069d52f250d74ff29b6a113a.
12:16:00.690 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1), deploy into slot with allocation id d35a590e069d52f250d74ff29b6a113a.
12:16:00.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from CREATED to DEPLOYING.
12:16:00.697 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) [DEPLOYING].
12:16:00.700 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a323d0e
12:16:00.700 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:00.700 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:00.700 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:16:00.701 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from DEPLOYING to INITIALIZING.
12:16:00.705 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:00.705 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:00.705 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:00.705 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:00.706 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@15ed166b
12:16:00.709 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.710 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:00.711 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.711 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from CREATED to DEPLOYING.
12:16:00.712 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) [DEPLOYING].
12:16:00.712 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2a457374
12:16:00.712 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:00.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:00.713 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:16:00.713 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from DEPLOYING to INITIALIZING.
12:16:00.719 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2fd435c5
12:16:00.723 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.723 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:00.724 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.724 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.725 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.725 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.726 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.727 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.727 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.727 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.733 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.733 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.733 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.733 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.734 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.734 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.736 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.736 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.736 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.736 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.737 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.745 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.745 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.746 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.746 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.746 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.747 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.747 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.748 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.749 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.752 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.755 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.756 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.756 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.756 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.756 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.757 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.757 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.757 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.757 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.757 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.758 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.758 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.758 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.759 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.759 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.759 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.759 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.761 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.761 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.761 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.761 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.761 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.765 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.765 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.765 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.766 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.766 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.766 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.766 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.767 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.767 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.768 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.768 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.768 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.768 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.768 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.769 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.769 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.770 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.771 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.773 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:00.773 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.774 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.774 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.774 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.774 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.774 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.775 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.776 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.776 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.776 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.776 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.776 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.777 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.777 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.777 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.778 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.778 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.778 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.780 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.781 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.781 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.781 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.786 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.789 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.789 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.790 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.790 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.790 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.790 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.791 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.795 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.797 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.797 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.797 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.797 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.798 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.798 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.798 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.799 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.799 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.799 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.799 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.800 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.800 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.800 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.800 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.801 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.801 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.801 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.801 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.801 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.803 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.803 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.803 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.803 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.803 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.804 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.804 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.804 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.804 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.805 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.805 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.805 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.805 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.805 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.805 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.805 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.806 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.806 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.806 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.806 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.806 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.806 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.806 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.807 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.807 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.807 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.807 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.807 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.807 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.807 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.809 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.809 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.809 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.809 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.810 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.810 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.810 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.810 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.810 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.810 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.810 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.810 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.810 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.811 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.811 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.811 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.811 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.811 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.811 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.811 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.812 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.812 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.812 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.812 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.815 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.815 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.815 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.815 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.815 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.815 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.815 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.815 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.815 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.816 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.816 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.816 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.816 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.817 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:00.825 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.825 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.826 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.826 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.826 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.826 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.826 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.826 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.826 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.827 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.827 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.827 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.827 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.827 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.827 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.829 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.830 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.830 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.830 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.830 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.830 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.830 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.830 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.830 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.831 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.831 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.831 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.831 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.831 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.832 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.832 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.832 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.832 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.832 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.832 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.833 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.833 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.833 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.833 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.833 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.835 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.835 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.835 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.836 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.836 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.836 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.836 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.837 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.837 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.837 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.838 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.838 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.838 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.838 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.838 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.838 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.838 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.838 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.838 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.838 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.852 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.852 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.853 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.853 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.853 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.853 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.853 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.853 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.853 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.853 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.853 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.853 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.853 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.857 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.857 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.857 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.857 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.857 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.858 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.858 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.858 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.858 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.866 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.866 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.866 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.867 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.867 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.867 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.867 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.867 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.867 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.867 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.867 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.870 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.870 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.870 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.870 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.870 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.870 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.870 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.871 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.871 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.871 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.871 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.871 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.874 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.875 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.875 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.875 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.875 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.875 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.875 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.875 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.875 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.875 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.886 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.886 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.886 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.889 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.889 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.889 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.889 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.889 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.889 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.889 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.890 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.890 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.890 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.891 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.891 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.891 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.891 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.892 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.892 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.892 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.892 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.892 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.892 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.892 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.895 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.895 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.895 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.895 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.895 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.895 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.896 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.896 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.896 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.896 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.896 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.896 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.896 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.898 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:00.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.898 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:00.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:00.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:00.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.898 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:00.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.898 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:00.898 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.898 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.898 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:00.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:00.898 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:00.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:00.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:00.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:00.899 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:00.911 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.911 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.911 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.911 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.911 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.911 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.911 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.911 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.911 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.912 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:00.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:00.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:00.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:00.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:00.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:00.918 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:00.927 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:00.927 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:00.927 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:00.927 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.927 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.927 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:00.927 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.927 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.927 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:00.928 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.928 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.928 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:00.928 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:00.930 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.930 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.930 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.930 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.930 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.930 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.931 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.969 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.969 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.970 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.970 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.970 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.970 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.970 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.973 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:00.973 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:00.973 [DEBUG - pool-336-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:00.973 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.973 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.973 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:00.973 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.973 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.973 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:00.974 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.974 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.974 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:00.974 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:00.974 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29826), Traces: [0ms] refreshing cache from master, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [73ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [76ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [76ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [90ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [93ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [140ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [157ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [157ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [201ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [222ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [262ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [382ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [382ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [382ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [382ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [422ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [761ms] refreshing cache from master, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [762ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [961ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [961ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [962ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [962ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1760ms] refreshing cache from master, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1761ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1762ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3720ms] refreshing cache from master, [3720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3721ms] too many traces: truncated at 100 traces, deferred=Deferred@1088400267(state=PENDING, result=null, callback=(continuation of Deferred@1359366870 after retry RPC after error@1517330630) -> (continuation of Deferred@2057114991 after retry RPC after error@1201891908) -> (continuation of Deferred@613472412 after retry RPC after error@2075732568) -> (continuation of Deferred@1763536429 after retry RPC after error@892393472) -> (continuation of Deferred@390504962 after retry RPC after error@631222616) -> (continuation of Deferred@661770176 after retry RPC after error@347268086) -> (continuation of Deferred@910558672 after retry RPC after error@1846245169) -> (continuation of Deferred@1202563839 after retry RPC after error@1149459631) -> (continuation of Deferred@1114483050 after retry RPC after error@2003496169) -> (continuation of Deferred@1572493993 after retry RPC after error@50463637) -> (continuation of Deferred@738974822 after retry RPC after error@212234410) -> (continuation of Deferred@63315077 after retry RPC after error@281786819) -> (continuation of Deferred@1649520464 after retry RPC after error@1573761168) -> (continuation of Deferred@1851567512 after retry RPC after error@596907057) -> (continuation of Deferred@1288705084 after retry RPC after error@2091475974) -> (continuation of Deferred@2006070886 after retry RPC after error@1948553529) -> (continuation of Deferred@949553781 after retry RPC after error@254267444) -> (continuation of Deferred@1776350896 after retry RPC after error@966598636) -> (continuation of Deferred@1235709960 after retry RPC after error@2016460664) -> (continuation of Deferred@378241976 after retry RPC after error@1194892538) -> (continuation of Deferred@904762149 after retry RPC after error@1213931935) -> (continuation of Deferred@42466671 after retry RPC after error@22769289) -> (continuation of Deferred@1484169532 after retry RPC after error@1236280436) -> (continuation of Deferred@1960957096 after retry RPC after error@773112731) -> (continuation of Deferred@1132918820 after retry RPC after error@190707620) -> (continuation of Deferred@1910716147 after retry RPC after error@2036542287), errback=(continuation of Deferred@1359366870 after retry RPC after error@1517330630) -> (continuation of Deferred@2057114991 after retry RPC after error@1201891908) -> (continuation of Deferred@613472412 after retry RPC after error@2075732568) -> (continuation of Deferred@1763536429 after retry RPC after error@892393472) -> (continuation of Deferred@390504962 after retry RPC after error@631222616) -> (continuation of Deferred@661770176 after retry RPC after error@347268086) -> (continuation of Deferred@910558672 after retry RPC after error@1846245169) -> (continuation of Deferred@1202563839 after retry RPC after error@1149459631) -> (continuation of Deferred@1114483050 after retry RPC after error@2003496169) -> (continuation of Deferred@1572493993 after retry RPC after error@50463637) -> (continuation of Deferred@738974822 after retry RPC after error@212234410) -> (continuation of Deferred@63315077 after retry RPC after error@281786819) -> (continuation of Deferred@1649520464 after retry RPC after error@1573761168) -> (continuation of Deferred@1851567512 after retry RPC after error@596907057) -> (continuation of Deferred@1288705084 after retry RPC after error@2091475974) -> (continuation of Deferred@2006070886 after retry RPC after error@1948553529) -> (continuation of Deferred@949553781 after retry RPC after error@254267444) -> (continuation of Deferred@1776350896 after retry RPC after error@966598636) -> (continuation of Deferred@1235709960 after retry RPC after error@2016460664) -> (continuation of Deferred@378241976 after retry RPC after error@1194892538) -> (continuation of Deferred@904762149 after retry RPC after error@1213931935) -> (continuation of Deferred@42466671 after retry RPC after error@22769289) -> (continuation of Deferred@1484169532 after retry RPC after error@1236280436) -> (continuation of Deferred@1960957096 after retry RPC after error@773112731) -> (continuation of Deferred@1132918820 after retry RPC after error@190707620) -> (continuation of Deferred@1910716147 after retry RPC after error@2036542287)))
12:16:00.975 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.975 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.975 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.976 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.976 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.976 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.976 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.976 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.976 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.976 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:00.994 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:00.995 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:00.995 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:00.995 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.995 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.995 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:00.996 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.996 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.996 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:00.996 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:00.996 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:01.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:01.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:01.001 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:01.001 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:01.001 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:01.002 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:01.002 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:01.002 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:01.002 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:01.002 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:01.002 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:01.002 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:01.006 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.006 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.006 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.006 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.006 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.006 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.006 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.006 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.006 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.007 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.007 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.007 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.007 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.010 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.010 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.010 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.011 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.011 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.011 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.011 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.011 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.011 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.011 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.012 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.012 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.012 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.012 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.013 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.013 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.013 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.013 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:01.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:01.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:01.037 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.037 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.037 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.038 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.038 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.038 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.038 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.038 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.038 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.038 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:01.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.211 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.211 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.211 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.212 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.212 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.212 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.212 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.212 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.212 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.212 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.212 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.245 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.246 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.246 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.246 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.246 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.246 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.247 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.247 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.247 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.247 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.247 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.247 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.297 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:01.297 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:01.298 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:01.298 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.298 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.298 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.298 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.298 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.298 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.298 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.298 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.298 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:01.300 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:01.301 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:01.301 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:01.301 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.301 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.301 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.301 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.301 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.302 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.302 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.302 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.302 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.302 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:01.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.375 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.375 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.375 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.376 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.376 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.376 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.376 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.376 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.376 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.376 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.376 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.376 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.376 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:01.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:01.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:01.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.458 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.458 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.458 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:01.458 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.458 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.458 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:01.458 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:01.458 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:01.487 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:01.487 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:01.487 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:01.488 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:01.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:01.488 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:01.488 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:01.488 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:01.488 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:01.488 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:01.488 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:01.488 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:01.488 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:01.537 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:01.538 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:01.538 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:01.538 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.538 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.538 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.538 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.538 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.538 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.538 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.539 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.538 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.539 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:01.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:01.487334 22954 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 22916
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:01.669981 22954 kernel_stack_watchdog.cc:198] Thread 22916 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 351ms:
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:01.670037 22916 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.535s	user 0.557s	sys 0.836s
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:00.136270 22956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:01.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:01.670392 22916 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.536s	user 0.557s	sys 0.836s
12:16:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.679175 22916 server_base.cc:1061] running on GCE node
12:16:01.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:01.679251 23021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:01.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.680711 22916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:01.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.682844 22916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:01.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.684178 22916 hybrid_clock.cc:648] HybridClock initialized: now 1783512961684138 us; error 34 us; skew 500 ppm
12:16:01.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.684998 22916 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:01.686 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.686 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.686 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.687 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.687 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.687 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.687 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.687 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.687 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.687 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.687 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.690 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.690 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.690 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.691 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.691 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.691 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.693 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.693 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.693 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.694 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.694 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.694 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.694 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.691 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.694 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.694 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.694 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.694 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.694 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.696 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.696 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.696 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.693212 22916 webserver.cc:533] Webserver started at http://127.21.224.130:40933/ using document root <none> and password file <none>
12:16:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.694713 22916 fs_manager.cc:362] Metadata directory not provided
12:16:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.695024 22916 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.695569 22916 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.700515 22916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data/instance:
12:16:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:01 on dist-test-slave-vcgh"
12:16:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.701649 22916 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal/instance:
12:16:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:01 on dist-test-slave-vcgh"
12:16:01.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.709656 22916 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
12:16:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.716034 23027 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:01.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.717379 22916 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.717700 22916 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:01 on dist-test-slave-vcgh"
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.718056 22916 fs_report.cc:389] FS layout report
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data/data
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:01.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:01.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.775000 22916 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:01.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.776849 22916 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:01.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.777331 22916 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:01.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:01.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:01.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:01.778 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.778 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.778 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.778 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.778 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.778 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:01.778 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.778 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:01.778 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:01.778 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:01.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.780287 22916 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:01.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.784454 22916 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:01.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.784679 22916 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:01.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.784933 22916 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:01.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.785071 22916 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:01.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:01.911 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:01.912 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:01.912 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:01.912 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.912 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.912 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.912 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.912 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:01.912 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:01.912 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.913 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.913 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:01.913 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.981154 22916 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.130:37235
12:16:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.981282 23139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.130:37235 every 8 connection(s)
12:16:01.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.983657 22916 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/data/info.pb
12:16:01.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.991840 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 22916
12:16:01.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:01.992295 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-1/wal/instance
12:16:02.001 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.002 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.002 [DEBUG - pool-330-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.003 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.004 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.004 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.004 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.004 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.004 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.004 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.004 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.004 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.004 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.014650 22402 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/logs
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data/info.pb
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.131:0
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.131
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.131
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:02.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.024376 23140 heartbeater.cc:344] Connected to a master server at 127.21.224.188:40821
12:16:02.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.024901 23140 heartbeater.cc:461] Registering TS with master...
12:16:02.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.025153 23141 heartbeater.cc:344] Connected to a master server at 127.21.224.189:39039
12:16:02.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.025501 23141 heartbeater.cc:461] Registering TS with master...
12:16:02.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.026681 23141 heartbeater.cc:507] Master 127.21.224.189:39039 requested a full tablet report, sending...
12:16:02.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.026286 23140 heartbeater.cc:507] Master 127.21.224.188:40821 requested a full tablet report, sending...
12:16:02.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.030789 22669 ts_manager.cc:194] Registered new tserver with Master: 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:02.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.032449 22586 ts_manager.cc:194] Registered new tserver with Master: 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:02.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.034235 22586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.224.130:60441
12:16:02.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.036170 23142 heartbeater.cc:344] Connected to a master server at 127.21.224.190:35543
12:16:02.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.036500 23142 heartbeater.cc:461] Registering TS with master...
12:16:02.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.037282 23142 heartbeater.cc:507] Master 127.21.224.190:35543 requested a full tablet report, sending...
12:16:02.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.039593 22510 ts_manager.cc:194] Registered new tserver with Master: 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:02.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.146 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:02.146 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:02.146 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:02.146 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.146 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.146 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.146 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.146 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.147 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.147 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:02.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:02.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:02.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:02.150 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:02.150 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:02.150 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:02.150 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:02.150 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:02.150 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:02.150 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:02.150 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:02.150 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:02.150 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:02.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:02.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:02.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:02.192 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.192 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.192 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.192 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.192 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.192 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.192 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.192 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:02.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.340 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RESTARTING to RUNNING.
12:16:02.341 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job c0988648dfcd43275159a42b4d64d13e from Checkpoint 61 @ 1783512870892 for c0988648dfcd43275159a42b4d64d13e located at file:/tmp/junit5149282460191757602/checkpoints/c0988648dfcd43275159a42b4d64d13e/chk-61.
12:16:02.341 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:16:02.341 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:02.342 [INFO - Thread-56] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:02.342 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
12:16:02.342 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state TERMINATED
12:16:02.342 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state TERMINATED
12:16:02.342 [DEBUG - Thread-56] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state TERMINATED
12:16:02.343 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
12:16:02.343 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:16:02.343 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to SCHEDULED.
12:16:02.344 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:02.344 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:02.344 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:16:02.344 [DEBUG - Thread-56] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:02.346 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:16:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.346128 23150 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:02.347 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from SCHEDULED to DEPLOYING.
12:16:02.347 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #4) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:16:02.347 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to SCHEDULED.
12:16:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.346782 23150 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:02.347 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from SCHEDULED to DEPLOYING.
12:16:02.348 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #4) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:16:02.348 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to SCHEDULED.
12:16:02.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.347728 23150 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:02.348 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from SCHEDULED to DEPLOYING.
12:16:02.349 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #4) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:16:02.349 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:02.349 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:02.350 [INFO - Thread-56] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:02.350 [INFO - Thread-56] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:02.352 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:16:02.353 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:16:02.353 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
12:16:02.353 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
12:16:02.354 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@789e3bb5
12:16:02.354 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:02.354 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:02.354 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:16:02.355 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:16:02.356 [DEBUG - Thread-56] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:02.356 [INFO - Thread-56] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:02.357 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:16:02.358 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:16:02.358 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from CREATED to DEPLOYING.
12:16:02.358 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) [DEPLOYING].
12:16:02.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5fdf0bfb
12:16:02.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:02.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:02.359 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@29a71d21
12:16:02.359 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:16:02.360 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from DEPLOYING to INITIALIZING.
12:16:02.361 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:16:02.362 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:16:02.362 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from CREATED to DEPLOYING.
12:16:02.362 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) [DEPLOYING].
12:16:02.363 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:02.363 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@359f9e04
12:16:02.363 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:02.363 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:02.363 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:16:02.364 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:02.364 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from DEPLOYING to INITIALIZING.
12:16:02.364 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:02.364 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:02.364 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:02.365 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7cb66c3b
12:16:02.367 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:02.368 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from CREATED to DEPLOYING.
12:16:02.368 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) [DEPLOYING].
12:16:02.369 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fc64dc4
12:16:02.369 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:02.369 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:02.369 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@20485999
12:16:02.369 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:16:02.370 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from DEPLOYING to INITIALIZING.
12:16:02.371 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:02.372 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@67a543f6
12:16:02.373 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.373 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:02.373 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.374 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.374 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.374 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.374 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.375 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#4] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.376 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.376 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.376 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.376 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.376 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.376 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.377 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.378 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.378 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#4] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.378 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.378 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.378 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.379 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.379 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.379 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.381 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.381 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.381 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.382 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.382 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#4] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.382 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.382 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.382 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.383 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.383 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.383 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.383 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.383 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.384 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.393 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.393 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.394 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.394 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.394 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.394 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.394 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.394 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.394 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.399356 23150 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:02.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.400727 23150 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.224.131
12:16:02.401 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.401 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.401 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.401 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.401 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.402 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.402 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.402 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.402 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.402 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.402 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.402 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.403 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.404 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.404 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.405 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.405 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.405 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.405 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.405 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.405 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.405 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.408 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.409 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.409 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.409 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.409 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.409 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.409 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.409 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.409 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.410 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.410 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.410 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.410 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.411 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.411 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.411 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.411 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.413 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.413 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.414 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.414 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.414 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:02.414 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:02.415 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:02.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.415 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.415 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:02.416 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.416 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.416 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.417 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.417 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.417 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.417 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.417 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.417 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.417 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.417 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.417 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.418 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.418 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.418 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.418 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.418 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.420 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.421 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.421 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.421 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.421 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.421 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.421 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.421 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.422 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.422 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.422 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.423 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.423 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.424 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.424 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.424 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.424 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.434 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.434 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.434 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.434 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.434 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.434 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.434 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.434 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.434 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.434 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.434 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.434 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.434 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.435 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.435 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.435 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.435 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.435 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.435 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.435 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.435 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.435 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.436 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.436 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.435 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.436 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.436 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.436 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.436 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.436 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.435 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.436 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.435 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.436 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.436 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.436 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.436 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.436 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.437 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.437 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.436 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.437 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.437 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.437 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.437 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.437 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.437 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.437 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.438 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.438 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.438 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.438 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.438 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.438 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.438 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.438 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.453 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.453 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.454 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.454 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.454 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.454 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.454 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.454 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.454 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.454 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.455 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.455 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.455 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.455 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.455 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.455 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.455 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.455 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.455 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.455 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.455 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.455 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.456 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.456 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.456 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.457 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.457 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.455 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.457 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.458 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.458 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.458 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.458 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.465507 23150 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:02.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.224.148:39449
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.224.131:0
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data/info.pb
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.224.131
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.224.190:35543,127.21.224.189:39039,127.21.224.188:40821
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.224.131
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/logs
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:02.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.467222 23150 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:02.469419 23150 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:02.473 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.473 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.473 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.473 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.473 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.473 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.474 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.474 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.474 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.475 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.475 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.475 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.475 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.475 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.476 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.477 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.477 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.478 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.478 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.478 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.478 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.485553 23209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:02.494 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.494 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.494 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.494 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.495 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.495 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.495 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.495 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.495 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.495 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.495 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.495 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.495 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.495 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.495 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.495 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.495 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.495 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.495 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.514 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.514 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.514 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.514 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.515 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.515 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.515 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.515 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.515 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.515 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.516 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.516 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.516 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.516 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.517 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.534 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.534 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.534 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.534 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.534 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.534 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.535 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.535 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.535 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.535 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.553 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:02.553 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:02.554 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:02.554 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:02.554 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:02.554 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:02.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:02.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:02.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:02.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:02.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:02.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:02.555 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:02.555 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.555 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.555 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.555 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.555 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.556 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.556 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.556 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.556 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.574 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.574 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.575 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.575 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.575 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.575 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.575 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.576 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.576 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.576 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.576 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.576 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.576 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.576 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.576 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.576 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.594 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.594 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.594 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.595 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.595 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.595 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.595 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.595 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.595 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.596 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.596 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.596 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.596 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.596 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.597 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.597 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.597 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.597 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.614 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.614 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.614 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.615 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.615 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.615 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.615 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.615 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.616 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.616 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.634 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.635 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.635 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.636 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.654 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.654 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.654 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.654 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.654 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.654 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.655 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.655 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.655 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.655 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.694 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.694 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.694 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.694 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.695 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.695 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.695 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.695 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.695 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.696 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.696 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.696 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.696 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.696 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.694 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.697 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.697 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.697 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.697 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.715 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.715 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.715 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.715 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.715 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.716 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.716 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.716 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.716 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.754 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:02.754 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:02.754 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:02.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:02.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:02.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:02.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:02.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.790 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:02.790 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:02.790 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:02.791 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.791 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.791 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:02.791 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.791 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.791 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:02.791 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.791 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.791 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:02.791 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:02.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:02.834 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.834 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.834 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.835 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.835 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.835 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.835 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.835 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.835 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.836 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.836 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.836 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.836 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.915 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.916 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.916 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.916 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.916 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.916 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.916 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.916 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.916 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.916 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.916 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.917 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:02.927 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:02.927 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:02.928 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:02.928 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:02.928 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:02.928 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:02.928 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:02.928 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:02.929 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:02.930 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:02.930 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:02.930 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:02.930 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:02.954 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:02.954 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:02.954 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:02.954 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.955 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.955 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.955 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:02.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:02.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:02.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.014 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:03.015 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:03.015 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:03.015 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.015 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.015 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.015 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.015 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.016 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.016 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.016 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:03.035 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.035 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.035 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.036 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.036 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.036 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.036 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.036 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.036 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.036 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.037 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.037 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.037 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.038249 23141 heartbeater.cc:499] Master 127.21.224.189:39039 was elected leader, sending a full tablet report...
12:16:03.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.102 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:03.103 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:03.103 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:03.103 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.103 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.103 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.103 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.103 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.103 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.103 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.103 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.104 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:03.113 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:03.113 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:03.113 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:03.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.114 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:03.115 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.115 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.116 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.116 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.116 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.116 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.116 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.117 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.117 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.117 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.117 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.117 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.117 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.173 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:03.174 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:03.174 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:03.174 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.174 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.174 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.175 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.175 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:03.254 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.254 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.254 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.254 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.255 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.255 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.255 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.255 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.274 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.274 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.275 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.275 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.276 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.276 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.276 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.276 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.373 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:03.374 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:03.374 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:03.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.374 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:03.454 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.454 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.454 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.455 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.455 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.461 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:03.461 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:03.461 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:03.461 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.461 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.461 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.461 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.461 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.461 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.462 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.462 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.462 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:03.474 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:03.474 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:03.474 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:03.475 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.475 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:03.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:03.475 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.475 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.475 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:03.475 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:03.489 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:03.489 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:03.489 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:03.490 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:03.490 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:03.490 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:03.490 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:03.490 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:03.490 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:03.491 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:03.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:03.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:03.491 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:03.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:03.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:03.601 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:03.601 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.601 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.602 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.602 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.602 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.602 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.602 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.602 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.602 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.602 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:03.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.677 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:03.677 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:03.677 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:03.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:03.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:03.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:03.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:03.677 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:03.678 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:03.678 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:03.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:03.678 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:03.678 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:03.696 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:03.696 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:03.696 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:03.696 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.696 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.697 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:03.697 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.697 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.697 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:03.697 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.697 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:03.697 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:03.709 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:03.710 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:03.710 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:03.710 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.710 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.710 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.710 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.711 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.711 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.711 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.711 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.711 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:03.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.487105 23210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:03.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:02.489750 23212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:03.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.715948 23150 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:03.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:03.716444 23211 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1227 milliseconds
12:16:03.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.721553 23150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:03.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.724289 23150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:03.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.725669 23150 hybrid_clock.cc:648] HybridClock initialized: now 1783512963725582 us; error 90 us; skew 500 ppm
12:16:03.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.726702 23150 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:03.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.733446 23150 webserver.cc:533] Webserver started at http://127.21.224.131:35753/ using document root <none> and password file <none>
12:16:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.734330 23150 fs_manager.cc:362] Metadata directory not provided
12:16:03.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.734551 23150 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:03.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.735116 23150 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:03.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.739512 23150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data/instance:
12:16:03.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:03 on dist-test-slave-vcgh"
12:16:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.740609 23150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal/instance:
12:16:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:03.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:03 on dist-test-slave-vcgh"
12:16:03.746 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:03.746 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:03.746 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:03.746 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.747 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.747 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.747 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.747 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.747 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.747 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.747 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.747 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:03.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.748538 23150 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
12:16:03.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.754593 23220 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:03.755 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:03.755 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:03.755 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:03.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:03.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.755 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.755757 23150 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
12:16:03.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:03.755 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.756 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:03.756 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.756234 23150 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal
12:16:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:03 on dist-test-slave-vcgh"
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.756541 23150 fs_report.cc:389] FS layout report
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data/data
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:03.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:03.761 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:03.761 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:03.761 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:03.762 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.762 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.762 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:03.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.762 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:03.762 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.763 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.763 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:03.763 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:03.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.808379 23150 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:03.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.810021 23150 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:03.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.810437 23150 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.813421 23150 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:03.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.818218 23150 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:03.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.818408 23150 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:03.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.818624 23150 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:03.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:03.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:03.818831 23150 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:03.977 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:03.978 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:03.978 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:03.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.978 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.978 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.978 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.978 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:03.978 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:03.978 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.979 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.979 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:03.979 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.000912 23150 rpc_server.cc:307] RPC server started. Bound to: 127.21.224.131:37413
12:16:04.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.001021 23333 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.224.131:37413 every 8 connection(s)
12:16:04.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.003396 23150 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/data/info.pb
12:16:04.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.013677 22402 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 23150
12:16:04.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.014104 22402 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster5325484940079712842/ts-2/wal/instance
12:16:04.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:04.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:04.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:04.017 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:04.017 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:04.017 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:04.018 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:04.018 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:04.018 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:04.018 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:04.018 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:04.018 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:04.018 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:04.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.057860 23335 heartbeater.cc:344] Connected to a master server at 127.21.224.189:39039
12:16:04.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.058413 23335 heartbeater.cc:461] Registering TS with master...
12:16:04.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.059265 23334 heartbeater.cc:344] Connected to a master server at 127.21.224.188:40821
12:16:04.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.059571 23334 heartbeater.cc:461] Registering TS with master...
12:16:04.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.059887 23335 heartbeater.cc:507] Master 127.21.224.189:39039 requested a full tablet report, sending...
12:16:04.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.060563 23334 heartbeater.cc:507] Master 127.21.224.188:40821 requested a full tablet report, sending...
12:16:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.062762 22586 ts_manager.cc:194] Registered new tserver with Master: 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.063184 22669 ts_manager.cc:194] Registered new tserver with Master: 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:04.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.064388 22586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.224.131:35153
12:16:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.082366 23336 heartbeater.cc:344] Connected to a master server at 127.21.224.190:35543
12:16:04.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.082744 23336 heartbeater.cc:461] Registering TS with master...
12:16:04.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.083405 23336 heartbeater.cc:507] Master 127.21.224.190:35543 requested a full tablet report, sending...
12:16:04.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.085639 22510 ts_manager.cc:194] Registered new tserver with Master: 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:04.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.093930 22402 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:16:04.105 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:16:04.105 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:16:04.106 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.224.190"
      port: 35543
    }
    bound_http_address {
      host: "127.21.224.190"
      port: 32789
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.224.189"
      port: 39039
    }
    bound_http_address {
      host: "127.21.224.189"
      port: 43695
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.224.188"
      port: 40821
    }
    bound_http_address {
      host: "127.21.224.188"
      port: 42047
    }
  }
}

12:16:04.106 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:16:04.107 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.224.129"
      port: 35357
    }
    bound_http_address {
      host: "127.21.224.129"
      port: 43523
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.224.130"
      port: 37235
    }
    bound_http_address {
      host: "127.21.224.130"
      port: 40933
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.224.131"
      port: 37413
    }
    bound_http_address {
      host: "127.21.224.131"
      port: 35753
    }
  }
}

12:16:04.107 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:16:04.109 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:04.110 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:04.111 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:04.111 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.36.190:33455(127.21.36.190:33455)] Successfully connected to peer
12:16:04.112 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:04.113 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.36.189:35221(127.21.36.189:35221)] Successfully connected to peer
12:16:04.115 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.190
12:16:04.123 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.189
12:16:04.127 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.36.188:41809(127.21.36.188:41809)] Successfully connected to peer
12:16:04.127 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.132 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:04.133 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:04.136 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x20cf5964, L:/127.0.0.1:35416 - R:/127.21.36.189:35221] using SASL/PLAIN
12:16:04.138 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7c8e66ad, L:/127.0.0.1:52964 - R:/127.21.36.190:33455] using SASL/PLAIN
12:16:04.141 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:04.142 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [31ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: OK, deferred=null) after lookup
12:16:04.143 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.188
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.143761 21695 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52964:
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:16:04.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:04.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:04.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.148803 21695 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:16:04.150 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:04.152 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7dee8421, L:/127.0.0.1:47526 - R:/127.21.36.188:41809] using SASL/PLAIN
12:16:04.188 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:04.197 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:04.197 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:04.198 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:04.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:04.198 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:04.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:04.198 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:04.198 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:04.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:04.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:04.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:04.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:04.198 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:04.261 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:04.261 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:04.262 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:04.262 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.262 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.262 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.262 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.269090 22322 tablet_service.cc:1511] Processing CreateTablet for tablet 6a07f1f4846c4dc89d48f0eb12f82116 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:04.262 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.271 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.271922 22324 tablet_service.cc:1511] Processing CreateTablet for tablet 071109eb1eb6484b816f6e592158c4db (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.272068 22326 tablet_service.cc:1511] Processing CreateTablet for tablet d3abe64b8dda4db0a7f9bf9b64d3c931 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:04.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.273455 22325 tablet_service.cc:1511] Processing CreateTablet for tablet 813326281f7b43a6aed811d25f91295c (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:04.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.271581 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a07f1f4846c4dc89d48f0eb12f82116. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.275188 22327 tablet_service.cc:1511] Processing CreateTablet for tablet 647c61a50b44498fa3eeefd2a9e9edf1 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:04.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.275938 22326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3abe64b8dda4db0a7f9bf9b64d3c931. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.269332 22323 tablet_service.cc:1511] Processing CreateTablet for tablet 16afc913be4442278554da31226401e4 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:04.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.276911 22323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afc913be4442278554da31226401e4. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.278317 22325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813326281f7b43a6aed811d25f91295c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.279928 22324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071109eb1eb6484b816f6e592158c4db. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.281703 22327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647c61a50b44498fa3eeefd2a9e9edf1. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.295 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:04.295 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:04.295 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:04.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.296 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.296 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.296 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.296 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.296 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.296 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.296 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:04.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.290612 22172 tablet_service.cc:1511] Processing CreateTablet for tablet 813326281f7b43a6aed811d25f91295c (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:04.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.293309 22170 tablet_service.cc:1511] Processing CreateTablet for tablet 16afc913be4442278554da31226401e4 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:04.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.294613 22170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afc913be4442278554da31226401e4. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.297115 22172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813326281f7b43a6aed811d25f91295c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.297851 22171 tablet_service.cc:1511] Processing CreateTablet for tablet 071109eb1eb6484b816f6e592158c4db (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:04.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.298907 22171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071109eb1eb6484b816f6e592158c4db. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.301259 22169 tablet_service.cc:1511] Processing CreateTablet for tablet 6a07f1f4846c4dc89d48f0eb12f82116 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:04.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.302508 22169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a07f1f4846c4dc89d48f0eb12f82116. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.303948 22174 tablet_service.cc:1511] Processing CreateTablet for tablet 647c61a50b44498fa3eeefd2a9e9edf1 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:04.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.305516 22174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647c61a50b44498fa3eeefd2a9e9edf1. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.306557 22173 tablet_service.cc:1511] Processing CreateTablet for tablet d3abe64b8dda4db0a7f9bf9b64d3c931 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:04.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.310189 22173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3abe64b8dda4db0a7f9bf9b64d3c931. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.345690 23368 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.350281 22031 tablet_service.cc:1511] Processing CreateTablet for tablet d3abe64b8dda4db0a7f9bf9b64d3c931 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:04.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.353360 22029 tablet_service.cc:1511] Processing CreateTablet for tablet 071109eb1eb6484b816f6e592158c4db (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:04.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.354651 22029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071109eb1eb6484b816f6e592158c4db. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.356949 23368 tablet_bootstrap.cc:654] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.359467 23368 log.cc:826] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: Log is configured to *not* fsync() on all Append() calls
12:16:04.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.361325 22030 tablet_service.cc:1511] Processing CreateTablet for tablet 813326281f7b43a6aed811d25f91295c (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.366080 22028 tablet_service.cc:1511] Processing CreateTablet for tablet 16afc913be4442278554da31226401e4 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:04.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.368638 22027 tablet_service.cc:1511] Processing CreateTablet for tablet 6a07f1f4846c4dc89d48f0eb12f82116 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:04.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.367110 22028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16afc913be4442278554da31226401e4. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.371464 22027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a07f1f4846c4dc89d48f0eb12f82116. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.373090 22030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813326281f7b43a6aed811d25f91295c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.374933 22032 tablet_service.cc:1511] Processing CreateTablet for tablet 647c61a50b44498fa3eeefd2a9e9edf1 (DEFAULT_TABLE table=replication_test_table [id=8cbe72cac826486282e905791861128e]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:04.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.375990 22032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647c61a50b44498fa3eeefd2a9e9edf1. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.376335 23368 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.376989 23368 ts_tablet_manager.cc:1403] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.006s
12:16:04.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.377586 22031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3abe64b8dda4db0a7f9bf9b64d3c931. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:04.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.404095 23368 raft_consensus.cc:359] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.405295 23368 raft_consensus.cc:385] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.405704 23368 raft_consensus.cc:740] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.406143 23370 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.407166 23368 consensus_queue.cc:260] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.423391 23370 tablet_bootstrap.cc:654] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.428516 23368 ts_tablet_manager.cc:1434] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.051s	user 0.027s	sys 0.020s
12:16:04.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.436921 23368 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.443222 23370 log.cc:826] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Log is configured to *not* fsync() on all Append() calls
12:16:04.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.448776 23368 tablet_bootstrap.cc:654] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.450769 23370 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.451329 23370 ts_tablet_manager.cc:1403] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.013s
12:16:04.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.470785 23375 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.472080 23368 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.472541 23368 ts_tablet_manager.cc:1403] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.002s
12:16:04.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.475616 23368 raft_consensus.cc:359] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.476274 23368 raft_consensus.cc:385] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.476536 23368 raft_consensus.cc:740] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.477254 23368 consensus_queue.cc:260] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.483449 23375 tablet_bootstrap.cc:654] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.486384 23375 log.cc:826] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Log is configured to *not* fsync() on all Append() calls
12:16:04.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.490007 23368 ts_tablet_manager.cc:1434] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
12:16:04.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.495126 23368 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.501852 23368 tablet_bootstrap.cc:654] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.507586 23368 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.508157 23368 ts_tablet_manager.cc:1403] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.013s	user 0.000s	sys 0.012s
12:16:04.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.507454 23370 raft_consensus.cc:359] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.508430 23375 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.508519 23370 raft_consensus.cc:385] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.508882 23370 raft_consensus.cc:740] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.509001 23375 ts_tablet_manager.cc:1403] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.016s
12:16:04.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.509883 23370 consensus_queue.cc:260] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.511365 23368 raft_consensus.cc:359] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.512019 23368 raft_consensus.cc:385] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.512368 23368 raft_consensus.cc:740] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.513082 23368 consensus_queue.cc:260] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.515772 23368 ts_tablet_manager.cc:1434] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
12:16:04.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.519905 23368 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.521328 23370 ts_tablet_manager.cc:1434] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.070s	user 0.036s	sys 0.001s
12:16:04.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.522432 23370 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.526508 23368 tablet_bootstrap.cc:654] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.534749 23368 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.535270 23370 tablet_bootstrap.cc:654] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.535329 23368 ts_tablet_manager.cc:1403] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
12:16:04.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.538064 23368 raft_consensus.cc:359] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.538774 23368 raft_consensus.cc:385] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.539063 23368 raft_consensus.cc:740] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.539820 23368 consensus_queue.cc:260] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.542232 23368 ts_tablet_manager.cc:1434] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
12:16:04.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.543236 23368 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.550848 23368 tablet_bootstrap.cc:654] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.554726 23370 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.555184 23370 ts_tablet_manager.cc:1403] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.015s
12:16:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.558895 23370 raft_consensus.cc:359] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.559583 23370 raft_consensus.cc:385] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.559859 23370 raft_consensus.cc:740] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.560 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:04.560 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:04.560 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:04.561 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.561 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.561 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.561 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.561 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.561 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.561 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.561 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.561214 23370 consensus_queue.cc:260] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.561 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.561 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:04.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.563357 23370 ts_tablet_manager.cc:1434] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
12:16:04.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.564311 23370 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.564466 23371 raft_consensus.cc:493] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.565037 23371 raft_consensus.cc:515] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.570703 23370 tablet_bootstrap.cc:654] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.578178 23371 leader_election.cc:290] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.581418 23378 raft_consensus.cc:493] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.581992 23378 raft_consensus.cc:515] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.586467 23378 leader_election.cc:290] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:16:04.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.589713 23370 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.590260 23370 ts_tablet_manager.cc:1403] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.002s
12:16:04.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.594115 23370 raft_consensus.cc:359] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.594810 23370 raft_consensus.cc:385] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.595080 23370 raft_consensus.cc:740] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.595278 23368 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.595750 23370 consensus_queue.cc:260] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.596580 23368 ts_tablet_manager.cc:1403] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.004s
12:16:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.599756 23370 ts_tablet_manager.cc:1434] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
12:16:04.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.600811 23370 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.605309 22244 tablet.cc:2406] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:04.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.606894 23370 tablet_bootstrap.cc:654] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.615605 23368 raft_consensus.cc:359] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.616468 23368 raft_consensus.cc:385] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.616801 23368 raft_consensus.cc:740] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.620895 23368 consensus_queue.cc:260] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.615876 23375 raft_consensus.cc:359] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.622709 23375 raft_consensus.cc:385] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.623579 23375 raft_consensus.cc:740] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.633483 23375 consensus_queue.cc:260] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.643450 23371 raft_consensus.cc:493] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.643920 23371 raft_consensus.cc:515] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.646010 23371 leader_election.cc:290] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.646464 23371 raft_consensus.cc:493] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.646852 23371 raft_consensus.cc:515] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.652063 22052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3abe64b8dda4db0a7f9bf9b64d3c931" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.651460 23371 leader_election.cc:290] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.626595 23368 ts_tablet_manager.cc:1434] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
12:16:04.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.660353 23368 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369: Bootstrap starting.
12:16:04.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.660722 22399 tablet.cc:2406] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.663358 22052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071109eb1eb6484b816f6e592158c4db" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.664417 23375 ts_tablet_manager.cc:1434] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.155s	user 0.028s	sys 0.009s
12:16:04.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.664505 23370 tablet_bootstrap.cc:492] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.664987 23370 ts_tablet_manager.cc:1403] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.012s
12:16:04.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.665642 23375 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.669422 23370 raft_consensus.cc:359] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.670073 23370 raft_consensus.cc:385] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.649832 22053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a07f1f4846c4dc89d48f0eb12f82116" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.650162 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afc913be4442278554da31226401e4" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.674268 22051 raft_consensus.cc:2468] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 0.
12:16:04.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.675246 23375 tablet_bootstrap.cc:654] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.677278 22127 leader_election.cc:343] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Illegal state: must be running to vote when last-logged opid is not known
12:16:04.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.676566 23370 raft_consensus.cc:740] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.680223 23370 consensus_queue.cc:260] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.687678 23370 ts_tablet_manager.cc:1434] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
12:16:04.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.689188 23375 tablet_bootstrap.cc:492] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.689600 23368 tablet_bootstrap.cc:654] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369: Neither blocks nor log segments found. Creating new log.
12:16:04.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.689677 23375 ts_tablet_manager.cc:1403] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
12:16:04.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.688647 23370 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.692543 23375 raft_consensus.cc:359] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.693244 23375 raft_consensus.cc:385] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.693547 23375 raft_consensus.cc:740] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.694219 23375 consensus_queue.cc:260] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.696556 23375 ts_tablet_manager.cc:1434] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
12:16:04.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.697360 23390 raft_consensus.cc:493] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.697871 23390 raft_consensus.cc:515] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.700259 23370 tablet_bootstrap.cc:654] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.699904 23390 leader_election.cc:290] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.701122 23375 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.707141 23375 tablet_bootstrap.cc:654] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.709 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:04.709 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:04.709 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:04.710 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.710 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.710 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.710 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.710 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:04.710 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:04.710 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.710 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.710 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:04.710 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:04.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.711588 23368 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369: No bootstrap required, opened a new log
12:16:04.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.712075 23368 ts_tablet_manager.cc:1403] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.000s
12:16:04.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.715008 23368 raft_consensus.cc:359] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.715555 23375 tablet_bootstrap.cc:492] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.715678 23368 raft_consensus.cc:385] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.715986 23375 ts_tablet_manager.cc:1403] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
12:16:04.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.716342 23368 raft_consensus.cc:740] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Initialized, Role: FOLLOWER
12:16:04.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.717090 23368 consensus_queue.cc:260] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.719390 23368 ts_tablet_manager.cc:1434] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
12:16:04.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.719203 23375 raft_consensus.cc:359] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.720765 23375 raft_consensus.cc:385] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.721042 23375 raft_consensus.cc:740] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.722280 23370 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.721921 23375 consensus_queue.cc:260] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.722514 22280 leader_election.cc:343] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Illegal state: must be running to vote when last-logged opid is not known
12:16:04.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.722798 23370 ts_tablet_manager.cc:1403] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
12:16:04.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.723738 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.723866 22280 leader_election.cc:343] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Illegal state: must be running to vote when last-logged opid is not known
12:16:04.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.724109 23375 ts_tablet_manager.cc:1434] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
12:16:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.724701 22280 leader_election.cc:304] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e24ca086a1e4322ad294d640b08f369, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.725208 23375 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.725571 23390 raft_consensus.cc:2804] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.725440 23370 raft_consensus.cc:359] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.725945 23390 raft_consensus.cc:493] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.726042 23370 raft_consensus.cc:385] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.726262 23390 raft_consensus.cc:3060] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.726341 23370 raft_consensus.cc:740] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.726894 23370 consensus_queue.cc:260] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.728791 23370 ts_tablet_manager.cc:1434] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
12:16:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.729857 23370 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9: Bootstrap starting.
12:16:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.731824 23375 tablet_bootstrap.cc:654] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.733664 22103 tablet.cc:2406] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:04.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.735983 23370 tablet_bootstrap.cc:654] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9: Neither blocks nor log segments found. Creating new log.
12:16:04.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.747619 23370 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9: No bootstrap required, opened a new log
12:16:04.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.748267 23370 ts_tablet_manager.cc:1403] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
12:16:04.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.748528 23378 raft_consensus.cc:493] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.748939 23378 raft_consensus.cc:515] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.750852 23378 leader_election.cc:290] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095), d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281)
12:16:04.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.751921 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.753207 22127 leader_election.cc:343] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Illegal state: must be running to vote when last-logged opid is not known
12:16:04.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.754652 23370 raft_consensus.cc:359] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.755460 23370 raft_consensus.cc:385] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.755951 23370 raft_consensus.cc:740] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Initialized, Role: FOLLOWER
12:16:04.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.756961 23370 consensus_queue.cc:260] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.759563 23375 tablet_bootstrap.cc:492] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.759989 23375 ts_tablet_manager.cc:1403] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.012s
12:16:04.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.761134 23370 ts_tablet_manager.cc:1434] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
12:16:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.762471 23375 raft_consensus.cc:359] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.763111 23375 raft_consensus.cc:385] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.763396 23375 raft_consensus.cc:740] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.764050 23375 consensus_queue.cc:260] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.768146 23378 raft_consensus.cc:493] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:04.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.768570 23378 raft_consensus.cc:515] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.769037 23375 ts_tablet_manager.cc:1434] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.736140 23390 raft_consensus.cc:515] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.770149 23375 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.770427 23378 leader_election.cc:290] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.772043 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813326281f7b43a6aed811d25f91295c" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0" is_pre_election: true
12:16:04.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.772564 22051 raft_consensus.cc:2468] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 0.
12:16:04.774 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:04.774 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:04.774 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:04.774 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:04.775 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:04.775 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:04.775 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:04.775 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:04.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:04.775 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:04.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.774330 22127 leader_election.cc:304] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.774370 22280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.21.36.129:45281, user_credentials={real_user=slave}} blocked reactor thread for 49757.6us
12:16:04.775 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:04.775 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:04.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.775897 23378 raft_consensus.cc:2804] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.776230 23378 raft_consensus.cc:493] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.776523 23378 raft_consensus.cc:3060] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.776993 23375 tablet_bootstrap.cc:654] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.783841 23375 tablet_bootstrap.cc:492] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.783739 22347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a07f1f4846c4dc89d48f0eb12f82116" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369" is_pre_election: true
12:16:04.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.784539 22347 raft_consensus.cc:2468] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 0.
12:16:04.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.785058 23390 leader_election.cc:290] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Requested vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.785156 23375 ts_tablet_manager.cc:1403] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.007s
12:16:04.794 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:04.794 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:04.794 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:04.794 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.794 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.794 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:04.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:04.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.785998 22346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369" is_pre_election: true
12:16:04.795 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.786635 22346 raft_consensus.cc:2468] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 0.
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.787703 22345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813326281f7b43a6aed811d25f91295c" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369" is_pre_election: true
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:04.783967 22280 leader_election.cc:343] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Illegal state: must be running to vote when last-logged opid is not known
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.788295 22345 raft_consensus.cc:2468] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 0.
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.788393 23375 raft_consensus.cc:359] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.789074 23375 raft_consensus.cc:385] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.789350 23375 raft_consensus.cc:740] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.790215 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afc913be4442278554da31226401e4" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.789950 23375 consensus_queue.cc:260] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.790699 22051 raft_consensus.cc:3060] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.792645 23375 ts_tablet_manager.cc:1434] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
12:16:04.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.792778 22127 leader_election.cc:304] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, 9e24ca086a1e4322ad294d640b08f369; no voters: d04ef4271a25405d8f61303c957c20e0
12:16:04.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.800217 22051 raft_consensus.cc:2468] T 16afc913be4442278554da31226401e4 P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.800078 23378 raft_consensus.cc:515] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.801288 22280 leader_election.cc:304] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e24ca086a1e4322ad294d640b08f369, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.801513 23378 leader_election.cc:290] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Requested vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:16:04.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.801986 23378 raft_consensus.cc:2804] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.802080 23390 raft_consensus.cc:2804] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.802451 23378 raft_consensus.cc:493] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.802964 23390 raft_consensus.cc:697] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [term 1 LEADER]: Becoming Leader. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Running, Role: LEADER
12:16:04.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.804479 23375 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0: Bootstrap starting.
12:16:04.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.804136 23390 consensus_queue.cc:237] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.806003 22127 leader_election.cc:304] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, 9e24ca086a1e4322ad294d640b08f369; no voters: d04ef4271a25405d8f61303c957c20e0
12:16:04.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.807515 23378 raft_consensus.cc:3060] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.809612 23398 raft_consensus.cc:2804] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.809984 23398 raft_consensus.cc:493] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.810304 23398 raft_consensus.cc:3060] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.812565 22194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3abe64b8dda4db0a7f9bf9b64d3c931" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9" is_pre_election: true
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.813305 22194 raft_consensus.cc:2468] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 0.
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.813319 22053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813326281f7b43a6aed811d25f91295c" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.813880 22053 raft_consensus.cc:3060] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.815339 22192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071109eb1eb6484b816f6e592158c4db" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9" is_pre_election: true
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.815965 22192 raft_consensus.cc:2468] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 0.
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.817173 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9" is_pre_election: true
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.818002 23378 raft_consensus.cc:515] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.818256 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afc913be4442278554da31226401e4" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9"
12:16:04.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.818832 22190 raft_consensus.cc:3060] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.819796 23378 leader_election.cc:290] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Requested vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095)
12:16:04.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.811385 22193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16afc913be4442278554da31226401e4" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9" is_pre_election: true
12:16:04.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.824905 22052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a07f1f4846c4dc89d48f0eb12f82116" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.825465 22052 raft_consensus.cc:3060] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.829869 22280 leader_election.cc:304] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, 9e24ca086a1e4322ad294d640b08f369; no voters: d04ef4271a25405d8f61303c957c20e0
12:16:04.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.830190 22053 raft_consensus.cc:2468] T 813326281f7b43a6aed811d25f91295c P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.831804 22052 raft_consensus.cc:2468] T 6a07f1f4846c4dc89d48f0eb12f82116 P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.813421 23375 tablet_bootstrap.cc:654] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0: Neither blocks nor log segments found. Creating new log.
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.833057 23371 raft_consensus.cc:2804] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.833400 23371 raft_consensus.cc:493] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.833684 23371 raft_consensus.cc:3060] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.832594 22127 leader_election.cc:304] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.834438 23378 raft_consensus.cc:2804] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.834599 22127 leader_election.cc:304] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.837395 23398 raft_consensus.cc:515] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.839399 22191 raft_consensus.cc:2393] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e24ca086a1e4322ad294d640b08f369 in current term 1: Already voted for candidate 8d2020977b084d98bff57776c1af7fc9 in this term.
12:16:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.841905 23398 leader_election.cc:290] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Requested vote from peers 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131:43095), d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281)
12:16:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.843464 23371 raft_consensus.cc:515] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.845871 23371 leader_election.cc:290] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Requested vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.847102 22280 leader_election.cc:304] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, 9e24ca086a1e4322ad294d640b08f369; no voters: d04ef4271a25405d8f61303c957c20e0
12:16:04.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.847703 22190 raft_consensus.cc:2468] T 16afc913be4442278554da31226401e4 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.852 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:04.852 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:04.852 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:04.852 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:04.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:04.852 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:04.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:04.852 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:04.852 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:04.853 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:04.853 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:04.853 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:04.853 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:04.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.854871 23398 raft_consensus.cc:2804] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.856218 23398 raft_consensus.cc:697] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Running, Role: LEADER
12:16:04.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.856417 22345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813326281f7b43a6aed811d25f91295c" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369"
12:16:04.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.856969 22345 raft_consensus.cc:3060] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.861564 22052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.862176 22052 raft_consensus.cc:3060] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.861785 23398 consensus_queue.cc:237] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.865355 22345 raft_consensus.cc:2468] T 813326281f7b43a6aed811d25f91295c P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.870287 22345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a07f1f4846c4dc89d48f0eb12f82116" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369"
12:16:04.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.870553 23371 raft_consensus.cc:2804] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.870576 22346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647c61a50b44498fa3eeefd2a9e9edf1" candidate_uuid: "8d2020977b084d98bff57776c1af7fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e24ca086a1e4322ad294d640b08f369"
12:16:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.870941 23371 raft_consensus.cc:493] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.871006 22345 raft_consensus.cc:3060] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.871150 22346 raft_consensus.cc:3060] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.871265 23371 raft_consensus.cc:3060] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.875949 23375 tablet_bootstrap.cc:492] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0: No bootstrap required, opened a new log
12:16:04.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.876397 23375 ts_tablet_manager.cc:1403] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.014s
12:16:04.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.877658 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3abe64b8dda4db0a7f9bf9b64d3c931" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.877748 22345 raft_consensus.cc:2468] T 6a07f1f4846c4dc89d48f0eb12f82116 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.878289 22051 raft_consensus.cc:3060] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.878746 22052 raft_consensus.cc:2468] T 647c61a50b44498fa3eeefd2a9e9edf1 P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.879791 22127 leader_election.cc:304] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d2020977b084d98bff57776c1af7fc9, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.880172 22346 raft_consensus.cc:2468] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d2020977b084d98bff57776c1af7fc9 in term 1.
12:16:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.880903 23400 raft_consensus.cc:2804] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.881546 23400 raft_consensus.cc:697] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Running, Role: LEADER
12:16:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.882499 22280 leader_election.cc:304] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e24ca086a1e4322ad294d640b08f369; no voters: 8d2020977b084d98bff57776c1af7fc9, d04ef4271a25405d8f61303c957c20e0
12:16:04.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.882507 23400 consensus_queue.cc:237] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } }
12:16:04.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.883292 22190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3abe64b8dda4db0a7f9bf9b64d3c931" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9"
12:16:04.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.884785 23375 raft_consensus.cc:359] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.885591 23375 raft_consensus.cc:385] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:04.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.885859 23375 raft_consensus.cc:740] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04ef4271a25405d8f61303c957c20e0, State: Initialized, Role: FOLLOWER
12:16:04.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.887372 23375 consensus_queue.cc:260] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.897099 23375 ts_tablet_manager.cc:1434] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
12:16:04.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.904973 22051 raft_consensus.cc:2468] T d3abe64b8dda4db0a7f9bf9b64d3c931 P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.904435 21695 catalog_manager.cc:5697] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131). New cstate: current_term: 1 leader_uuid: "9e24ca086a1e4322ad294d640b08f369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: HEALTHY } } }
12:16:04.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.906581 23371 raft_consensus.cc:515] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.908536 23371 leader_election.cc:290] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Requested vote from peers d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281), 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130:37613)
12:16:04.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.883839 22190 raft_consensus.cc:3060] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.915059 23390 raft_consensus.cc:2749] T 647c61a50b44498fa3eeefd2a9e9edf1 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:04.918 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:04.918 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:04.918 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:04.918 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.918 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.918 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.918 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.918 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:04.918 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:04.918 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.918 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.918 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:04.918 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:04.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.920805 22280 leader_election.cc:304] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e24ca086a1e4322ad294d640b08f369, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.921406 22051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071109eb1eb6484b816f6e592158c4db" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04ef4271a25405d8f61303c957c20e0"
12:16:04.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.921964 22051 raft_consensus.cc:3060] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.920351 22191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071109eb1eb6484b816f6e592158c4db" candidate_uuid: "9e24ca086a1e4322ad294d640b08f369" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d2020977b084d98bff57776c1af7fc9"
12:16:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.922571 23404 raft_consensus.cc:2804] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.922782 22191 raft_consensus.cc:3060] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 0 FOLLOWER]: Advancing to term 1
12:16:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.922996 23404 raft_consensus.cc:697] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [term 1 LEADER]: Becoming Leader. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Running, Role: LEADER
12:16:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.925549 23404 consensus_queue.cc:237] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.929618 22051 raft_consensus.cc:2468] T 071109eb1eb6484b816f6e592158c4db P d04ef4271a25405d8f61303c957c20e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.931231 22191 raft_consensus.cc:2468] T 071109eb1eb6484b816f6e592158c4db P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.925596 22190 raft_consensus.cc:2468] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 8d2020977b084d98bff57776c1af7fc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e24ca086a1e4322ad294d640b08f369 in term 1.
12:16:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.930790 22280 leader_election.cc:304] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e24ca086a1e4322ad294d640b08f369, d04ef4271a25405d8f61303c957c20e0; no voters: 
12:16:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.935626 23390 raft_consensus.cc:2804] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 1 FOLLOWER]: Leader election won for term 1
12:16:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.935154 23378 raft_consensus.cc:697] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8d2020977b084d98bff57776c1af7fc9, State: Running, Role: LEADER
12:16:04.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.937688 23378 consensus_queue.cc:237] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.942147 23390 raft_consensus.cc:697] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [term 1 LEADER]: Becoming Leader. State: Replica: 9e24ca086a1e4322ad294d640b08f369, State: Running, Role: LEADER
12:16:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.943046 23390 consensus_queue.cc:237] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } }
12:16:04.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:04.970971 21694 catalog_manager.cc:5697] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130). New cstate: current_term: 1 leader_uuid: "8d2020977b084d98bff57776c1af7fc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: UNKNOWN } } }
12:16:05.018 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:05.018 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:05.018 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:05.018 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:05.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:05.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:05.019 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:05.019 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:05.019 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:05.019 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:05.019 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:05.020 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:05.020 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:05.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.067557 23335 heartbeater.cc:499] Master 127.21.224.189:39039 was elected leader, sending a full tablet report...
12:16:05.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.075044 21694 catalog_manager.cc:5697] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130). New cstate: current_term: 1 leader_uuid: "8d2020977b084d98bff57776c1af7fc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: UNKNOWN } } }
12:16:05.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.071863 21695 catalog_manager.cc:5697] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131). New cstate: current_term: 1 leader_uuid: "9e24ca086a1e4322ad294d640b08f369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: HEALTHY } } }
12:16:05.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.077364 21694 catalog_manager.cc:5697] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d2020977b084d98bff57776c1af7fc9 (127.21.36.130). New cstate: current_term: 1 leader_uuid: "8d2020977b084d98bff57776c1af7fc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: HEALTHY } } }
12:16:05.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.078559 21695 catalog_manager.cc:5697] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e24ca086a1e4322ad294d640b08f369 (127.21.36.131). New cstate: current_term: 1 leader_uuid: "9e24ca086a1e4322ad294d640b08f369" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 } health_report { overall_health: HEALTHY } } }
12:16:05.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.195 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:05.195 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:05.195 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:05.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.195 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.195 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.195 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.195 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.195 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.195 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.195 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.195 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:05.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:05.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:05.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:05.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.234 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.234 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.234 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.235 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.235 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.235 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:05.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.287 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:05.287 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:05.288 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:05.288 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:05.288 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:05.288 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:05.288 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:05.288 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:05.288 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:05.288 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:05.288 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:05.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:05.288 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:05.293 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:05.293 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:05.293 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:05.293 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.293 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.293 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.294 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:05.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.315382 23378 consensus_queue.cc:1048] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.333 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:05.333 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:05.333 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:05.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.332276 23399 consensus_queue.cc:1048] T 6a07f1f4846c4dc89d48f0eb12f82116 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.333 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.333 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.333 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.334 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:05.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.343604 23404 consensus_queue.cc:1048] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.361874 23404 consensus_queue.cc:1048] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.365350 23378 consensus_queue.cc:1048] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.386206 23407 consensus_queue.cc:1048] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.398995 23407 consensus_queue.cc:1048] T 071109eb1eb6484b816f6e592158c4db P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.407554 23407 consensus_queue.cc:1048] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d2020977b084d98bff57776c1af7fc9" member_type: VOTER last_known_addr { host: "127.21.36.130" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.410044 23378 consensus_queue.cc:1048] T 647c61a50b44498fa3eeefd2a9e9edf1 P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.422600 23407 consensus_queue.cc:1048] T 16afc913be4442278554da31226401e4 P 9e24ca086a1e4322ad294d640b08f369 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:16:05.453 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:05.454 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:05.454 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:05.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.454 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.454 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:05.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:05.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:05.455 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:05.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.456388 23399 consensus_queue.cc:1048] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04ef4271a25405d8f61303c957c20e0" member_type: VOTER last_known_addr { host: "127.21.36.129" port: 45281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:05.508378 23378 consensus_queue.cc:1048] T 813326281f7b43a6aed811d25f91295c P 8d2020977b084d98bff57776c1af7fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e24ca086a1e4322ad294d640b08f369" member_type: VOTER last_known_addr { host: "127.21.36.131" port: 43095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:05.549 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:05.549 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:05.549 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:05.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:05.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:05.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:05.550 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:05.550 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:05.550 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:05.550 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:05.550 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:05.550 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:05.550 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:05.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.716 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:05.721 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:05.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.36.190:33455, [4ms] Sub RPC GetTableLocations: received response from server master-127.21.36.190:33455: OK, deferred=null) after lookup
12:16:05.722 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] connecting to peer
12:16:05.723 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] Successfully connected to peer
12:16:05.736 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:05.738 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x17bae9b8, L:/127.0.0.1:51954 - R:/127.21.36.130:37613] using TOKEN/null
12:16:05.771 [DEBUG - main] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:05.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.774 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:05.774 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:05.774 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:05.774 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.774 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.774 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:05.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:05.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.775 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:05.776 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:05.780 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:05.791 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:05.793 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xcb38058d, L:/127.0.0.1:41742 - R:/127.21.36.131:43095] using TOKEN/null
12:16:05.816 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:05.816 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:05.817 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:05.817 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:05.817 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:05.817 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:05.818 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:05.818 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:05.818 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:05.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:05.817 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:05.818 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:05.819 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:05.819 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:06.012 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:06.015 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:06.031 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:06.031 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:06.032 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:06.032 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:06.032 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:06.033 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:06.038 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:06.049 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:06.050 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:06.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.057 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:06.057 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:06.057 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:06.057 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:06.057 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:06.057 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:06.057 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:06.057 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:06.057 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:06.058 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:06.058 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:06.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:06.058 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:06.061 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.063 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.066 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.069 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xac57c53a, L:/127.0.0.1:51238 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:06.071 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa9454133, L:/127.0.0.1:36026 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:06.081 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x701e26e1, L:/127.0.0.1:43600 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:06.084 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:06.084 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=69), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [45ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.188:40821: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.190:35543: OK, [54ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:06.088 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:06.088 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:06.089 [DEBUG - main] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:06.089 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.36.190:33455(127.21.36.190:33455)] Successfully connected to peer
12:16:06.097 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.36.189:35221(127.21.36.189:35221)] Successfully connected to peer
12:16:06.103 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.36.188:41809(127.21.36.188:41809)] Successfully connected to peer
12:16:06.112 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.189
12:16:06.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.119 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.190
12:16:06.124 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.188
12:16:06.127 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.133 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7749560b, L:/127.0.0.1:52970 - R:/127.21.36.190:33455] using SASL/PLAIN
12:16:06.136 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.140 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xcaa5f045, L:/127.0.0.1:35418 - R:/127.21.36.189:35221] using SASL/PLAIN
12:16:06.144 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:06.146 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:06.146 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [55ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: OK, deferred=null) after lookup
12:16:06.149 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xcc20004b, L:/127.0.0.1:47532 - R:/127.21.36.188:41809] using SASL/PLAIN
12:16:06.150 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:06.155 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:06.155 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:06.156 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:06.156 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:06.156 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:06.156 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:06.156 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.159487 22586 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51238:
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key1"
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:06.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key2"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key3"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "data"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\007\000"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key1"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 3
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 0
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   hash_schema {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key2"
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:06.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key3"
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     num_buckets: 2
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     seed: 42
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:16:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.163904 22586 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:16:06.213 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:06.277 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.310 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:06.310 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:06.310 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:06.311 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.311 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.311 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.311 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.311 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.311 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.311 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.311 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.311 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.311 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:06.321 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.325443 23267 tablet_service.cc:1511] Processing CreateTablet for tablet b7ddb05d5d1045b5908e623a2aa560cf (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:06.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.325634 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 16a96b2aa0de460b91f73b91837cd938 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:06.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.324800 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed12c303849ad88879ee51f1e65d5 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:06.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.326874 23267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ddb05d5d1045b5908e623a2aa560cf. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.327504 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a96b2aa0de460b91f73b91837cd938. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.325448 23269 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed12c303849ad88879ee51f1e65d5 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:06.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.330211 23269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed12c303849ad88879ee51f1e65d5. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.324266 23268 tablet_service.cc:1511] Processing CreateTablet for tablet 28ba685ff6104af184a6435f42a45254 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:06.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.332252 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ba685ff6104af184a6435f42a45254. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.334015 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 28ba685ff6104af184a6435f42a45254 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:06.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.336598 22838 tablet_service.cc:1511] Processing CreateTablet for tablet b7ddb05d5d1045b5908e623a2aa560cf (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.338961 22837 tablet_service.cc:1511] Processing CreateTablet for tablet 16a96b2aa0de460b91f73b91837cd938 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:06.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.343237 22836 tablet_service.cc:1511] Processing CreateTablet for tablet 50f99869ee7148fdbe17c4cdb611c839 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:06.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.346518 23265 tablet_service.cc:1511] Processing CreateTablet for tablet 50f99869ee7148fdbe17c4cdb611c839 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:06.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.347600 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f99869ee7148fdbe17c4cdb611c839. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.349304 22835 tablet_service.cc:1511] Processing CreateTablet for tablet bd95f899c3fc422bb6d028773bf76481 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:06.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.346239 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed12c303849ad88879ee51f1e65d5. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.353680 22835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd95f899c3fc422bb6d028773bf76481. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.355172 23264 tablet_service.cc:1511] Processing CreateTablet for tablet bd95f899c3fc422bb6d028773bf76481 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:06.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.356200 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd95f899c3fc422bb6d028773bf76481. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.357149 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ba685ff6104af184a6435f42a45254. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.358997 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a96b2aa0de460b91f73b91837cd938. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.361886 22836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f99869ee7148fdbe17c4cdb611c839. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.362617 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ddb05d5d1045b5908e623a2aa560cf. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.402 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:06.402 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:06.402 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:06.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.403 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.403 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.403 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.403 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.403 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.403 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.428385 23479 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.448278 23070 tablet_service.cc:1511] Processing CreateTablet for tablet bd95f899c3fc422bb6d028773bf76481 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 1
12:16:06.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.449182 23072 tablet_service.cc:1511] Processing CreateTablet for tablet 16a96b2aa0de460b91f73b91837cd938 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 1
12:16:06.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.449972 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd95f899c3fc422bb6d028773bf76481. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.451164 23071 tablet_service.cc:1511] Processing CreateTablet for tablet 50f99869ee7148fdbe17c4cdb611c839 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 2, HASH (key2, key3) PARTITION 0
12:16:06.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.452203 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f99869ee7148fdbe17c4cdb611c839. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.453032 23074 tablet_service.cc:1511] Processing CreateTablet for tablet 28ba685ff6104af184a6435f42a45254 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 1
12:16:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.453251 23073 tablet_service.cc:1511] Processing CreateTablet for tablet b7ddb05d5d1045b5908e623a2aa560cf (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 1, HASH (key2, key3) PARTITION 0
12:16:06.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.454061 23074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ba685ff6104af184a6435f42a45254. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.454699 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a96b2aa0de460b91f73b91837cd938. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.455013 23479 tablet_bootstrap.cc:654] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.457012 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ddb05d5d1045b5908e623a2aa560cf. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.456719 23075 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed12c303849ad88879ee51f1e65d5 (DEFAULT_TABLE table=replication_test_table [id=251f93a4acb14229b56bc5e591ca5eab]), partition=HASH (key1) PARTITION 0, HASH (key2, key3) PARTITION 0
12:16:06.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.458410 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed12c303849ad88879ee51f1e65d5. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:06.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.473395 23479 log.cc:826] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Log is configured to *not* fsync() on all Append() calls
12:16:06.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.478461 23480 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.504578 23479 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.504539 23480 tablet_bootstrap.cc:654] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.505134 23479 ts_tablet_manager.cc:1403] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.000s
12:16:06.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.507055 23480 log.cc:826] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: Log is configured to *not* fsync() on all Append() calls
12:16:06.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.534593 23479 raft_consensus.cc:359] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.535459 23479 raft_consensus.cc:385] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.535738 23479 raft_consensus.cc:740] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.537202 23479 consensus_queue.cc:260] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.546627 23479 ts_tablet_manager.cc:1434] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.041s	user 0.026s	sys 0.009s
12:16:06.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.557135 23479 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.564543 23479 tablet_bootstrap.cc:654] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.576869 23479 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.577284 23479 ts_tablet_manager.cc:1403] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
12:16:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.579735 23341 tablet.cc:2406] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.579912 23479 raft_consensus.cc:359] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.580531 23479 raft_consensus.cc:385] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.580826 23479 raft_consensus.cc:740] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.581424 23479 consensus_queue.cc:260] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.587666 23479 ts_tablet_manager.cc:1434] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
12:16:06.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.593174 23479 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.599063 23479 tablet_bootstrap.cc:654] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.610122 23479 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.610530 23479 ts_tablet_manager.cc:1403] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
12:16:06.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.612993 23479 raft_consensus.cc:359] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.613607 23479 raft_consensus.cc:385] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.613860 23479 raft_consensus.cc:740] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.614704 23479 consensus_queue.cc:260] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.623327 23479 ts_tablet_manager.cc:1434] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
12:16:06.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.628543 23479 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.634217 23479 tablet_bootstrap.cc:654] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.640005 23484 raft_consensus.cc:493] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.640518 23484 raft_consensus.cc:515] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:06.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:06.647 [DEBUG - pool-320-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:06.648 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:06.648 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:06.648 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:06.648 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:06.648 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:06.648 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:06.648 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:06.649 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:06.649 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:06.649 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.653884 23484 leader_election.cc:290] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.654462 23480 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:06.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.655100 23480 ts_tablet_manager.cc:1403] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.177s	user 0.025s	sys 0.020s
12:16:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.660918 23490 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.673228 23490 tablet_bootstrap.cc:654] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:06.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.675604 23490 log.cc:826] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Log is configured to *not* fsync() on all Append() calls
12:16:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.681950 23490 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:06.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.683344 23490 ts_tablet_manager.cc:1403] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
12:16:06.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.701447 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:06.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.703032 23479 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.703454 23479 ts_tablet_manager.cc:1403] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.008s
12:16:06.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.704418 23223 leader_election.cc:343] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.707413 23479 raft_consensus.cc:359] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.708180 23479 raft_consensus.cc:385] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.708535 23479 raft_consensus.cc:740] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.709393 23479 consensus_queue.cc:260] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.711889 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.713951 23222 leader_election.cc:343] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.714363 23222 leader_election.cc:304] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 035e9dc71535495dad5692c3f75985a8, 47c08d351c2d48108b4850a050167e82
12:16:06.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.719286 23484 raft_consensus.cc:2749] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.719764 23490 raft_consensus.cc:359] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.720635 23490 raft_consensus.cc:385] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.720958 23490 raft_consensus.cc:740] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.722926 23490 consensus_queue.cc:260] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.727632 23479 ts_tablet_manager.cc:1434] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
12:16:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.734019 23490 ts_tablet_manager.cc:1434] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.050s	user 0.025s	sys 0.014s
12:16:06.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.734984 23490 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:06.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.742993 23490 tablet_bootstrap.cc:654] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.743960 23479 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.745600 23480 raft_consensus.cc:359] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.748353 23480 raft_consensus.cc:385] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.750319 23479 tablet_bootstrap.cc:654] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.750190 23480 raft_consensus.cc:740] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:06.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.757041 23480 consensus_queue.cc:260] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.759900 23147 tablet.cc:2406] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:06.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.776371 23480 ts_tablet_manager.cc:1434] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.121s	user 0.035s	sys 0.000s
12:16:06.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.776661 23479 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.777155 23479 ts_tablet_manager.cc:1403] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.010s
12:16:06.778 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.777891 23480 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.785317 23479 raft_consensus.cc:359] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.786015 23479 raft_consensus.cc:385] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.786283 23479 raft_consensus.cc:740] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.787102 23479 consensus_queue.cc:260] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.788805 23490 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:06.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.789229 23490 ts_tablet_manager.cc:1403] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.017s
12:16:06.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.799003 23480 tablet_bootstrap.cc:654] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:06.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.799816 23490 raft_consensus.cc:359] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.800506 23490 raft_consensus.cc:385] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.800925 23490 raft_consensus.cc:740] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.801661 23490 consensus_queue.cc:260] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.806515 23479 ts_tablet_manager.cc:1434] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
12:16:06.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.808972 23490 ts_tablet_manager.cc:1434] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
12:16:06.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:06.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.822194 23484 raft_consensus.cc:493] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:06.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.822672 23484 raft_consensus.cc:515] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.826191 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.829241 23223 leader_election.cc:343] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.824616 23484 leader_election.cc:290] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:06.831 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:06.831 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:06.831 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:06.832 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.832 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.832 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.832 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:06.832 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.832 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:06.832 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.832 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.832 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:06.832 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:06.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.833717 23479 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384: Bootstrap starting.
12:16:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.827474 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.839859 23222 leader_election.cc:343] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.840256 23222 leader_election.cc:304] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 035e9dc71535495dad5692c3f75985a8, 47c08d351c2d48108b4850a050167e82
12:16:06.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.840870 23490 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:06.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.841675 23484 raft_consensus.cc:2749] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:06.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.847849 23479 tablet_bootstrap.cc:654] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384: Neither blocks nor log segments found. Creating new log.
12:16:06.861 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:06.862 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:06.862 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:06.862 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.862 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.862 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.862 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.862 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.862 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.862 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.862 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.862 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.866039 23490 tablet_bootstrap.cc:654] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:06.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.873453 23480 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.873993 23480 ts_tablet_manager.cc:1403] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.008s
12:16:06.881 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:06.881 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:06.881 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:06.881 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:06.882 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:06.882 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:06.882 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:06.882 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:06.882 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:06.883 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:06.883 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:06.883 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:06.883 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:06.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.898100 23480 raft_consensus.cc:359] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.898833 23480 raft_consensus.cc:385] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.902082 23480 raft_consensus.cc:740] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:06.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.902772 23480 consensus_queue.cc:260] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.912118 23480 ts_tablet_manager.cc:1434] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
12:16:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.912959 23480 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.915649 23490 tablet_bootstrap.cc:492] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.916057 23490 ts_tablet_manager.cc:1403] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.005s
12:16:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.919586 23484 raft_consensus.cc:493] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:06.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.920054 23484 raft_consensus.cc:515] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.922237 23484 leader_election.cc:290] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.918586 23490 raft_consensus.cc:359] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.925565 23490 raft_consensus.cc:385] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.925879 23490 raft_consensus.cc:740] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:06.929 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:06.929 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:06.929 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:06.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:06.930 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.930 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.930 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:06.930 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.930 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.930 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:06.930 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:06.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.929972 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:06.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.930691 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:06.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.931380 23222 leader_election.cc:343] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.932964 23223 leader_election.cc:343] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.933343 23223 leader_election.cc:304] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 035e9dc71535495dad5692c3f75985a8, 47c08d351c2d48108b4850a050167e82
12:16:06.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.933538 23490 consensus_queue.cc:260] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.936869 23484 raft_consensus.cc:2749] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:06.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.944423 23480 tablet_bootstrap.cc:654] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.945629 23490 ts_tablet_manager.cc:1434] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
12:16:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.949191 23490 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:06.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.961552 23484 raft_consensus.cc:493] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:06.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.962015 23484 raft_consensus.cc:515] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.963915 23484 leader_election.cc:290] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:06.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.965814 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:06.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.966427 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:06.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.967120 23095 raft_consensus.cc:2468] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 0.
12:16:06.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.967255 23223 leader_election.cc:343] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.968436 23222 leader_election.cc:304] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 47c08d351c2d48108b4850a050167e82
12:16:06.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.969480 23484 raft_consensus.cc:2804] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.969883 23484 raft_consensus.cc:493] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.970032 22913 tablet.cc:2406] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.970291 23484 raft_consensus.cc:3060] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:06.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.976895 23484 raft_consensus.cc:515] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:06.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.981563 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82"
12:16:06.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.982882 23223 leader_election.cc:343] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Illegal state: must be running to vote when last-logged opid is not known
12:16:06.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:06.984828 22127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.36.131:43095, user_credentials={real_user=slave}} blocked reactor thread for 63944.6us
12:16:06.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.985173 23479 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384: No bootstrap required, opened a new log
12:16:06.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.985809 23479 ts_tablet_manager.cc:1403] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.032s
12:16:06.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.987159 23484 leader_election.cc:290] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 election: Requested vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:06.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.987350 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:06.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.987888 23095 raft_consensus.cc:3060] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:06.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.991513 23479 raft_consensus.cc:359] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.992128 23479 raft_consensus.cc:385] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:06.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.992413 23479 raft_consensus.cc:740] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Initialized, Role: FOLLOWER
12:16:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.995039 23095 raft_consensus.cc:2468] T 69aed12c303849ad88879ee51f1e65d5 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 1.
12:16:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.996181 23222 leader_election.cc:304] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 47c08d351c2d48108b4850a050167e82
12:16:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.994897 23479 consensus_queue.cc:260] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:06.996965 23484 raft_consensus.cc:2804] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.006206 23490 tablet_bootstrap.cc:654] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:07.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.012275 23480 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:07.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.012758 23480 ts_tablet_manager.cc:1403] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.006s
12:16:07.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.014353 23484 raft_consensus.cc:697] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 LEADER]: Becoming Leader. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Running, Role: LEADER
12:16:07.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.015369 23484 consensus_queue.cc:237] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:07.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.017416 23480 raft_consensus.cc:359] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.017758 23479 ts_tablet_manager.cc:1434] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
12:16:07.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.017952 23480 raft_consensus.cc:385] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.022943 23480 raft_consensus.cc:740] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:07.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.023921 23480 consensus_queue.cc:260] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.034693 23480 ts_tablet_manager.cc:1434] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
12:16:07.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.039215 23480 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:07.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.057446 23490 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:07.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.057883 23490 ts_tablet_manager.cc:1403] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.002s
12:16:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.062917 23490 raft_consensus.cc:359] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.065891 23490 raft_consensus.cc:385] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.068428 23480 tablet_bootstrap.cc:654] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.066197 23490 raft_consensus.cc:740] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:07.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.069622 22586 catalog_manager.cc:5697] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131). New cstate: current_term: 1 leader_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: UNKNOWN } } }
12:16:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.069067 23490 consensus_queue.cc:260] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.090852 23480 tablet_bootstrap.cc:492] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:07.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.091486 23480 ts_tablet_manager.cc:1403] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.006s
12:16:07.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.094434 23480 raft_consensus.cc:359] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.095079 23480 raft_consensus.cc:385] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.095350 23480 raft_consensus.cc:740] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:07.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.096014 23480 consensus_queue.cc:260] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.098016 23480 ts_tablet_manager.cc:1434] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
12:16:07.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.106448 23490 ts_tablet_manager.cc:1434] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
12:16:07.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.110018 23480 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:07.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.121109 23484 raft_consensus.cc:493] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.121556 23484 raft_consensus.cc:515] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.123528 23484 leader_election.cc:290] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:07.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.125391 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ddb05d5d1045b5908e623a2aa560cf" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:07.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.125490 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ddb05d5d1045b5908e623a2aa560cf" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:07.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.125991 23095 raft_consensus.cc:2468] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 0.
12:16:07.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.126181 22860 raft_consensus.cc:2468] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 0.
12:16:07.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.127141 23222 leader_election.cc:304] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 
12:16:07.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.128415 23484 raft_consensus.cc:2804] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:07.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.128737 23484 raft_consensus.cc:493] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:07.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.129014 23484 raft_consensus.cc:3060] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.133538 23480 tablet_bootstrap.cc:654] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:07.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.137197 23496 raft_consensus.cc:493] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.137691 23496 raft_consensus.cc:515] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.141458 23490 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:07.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.143515 23484 raft_consensus.cc:515] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.145941 23496 leader_election.cc:290] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.159973 23492 raft_consensus.cc:493] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.160463 23492 raft_consensus.cc:515] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.169992 23480 tablet_bootstrap.cc:492] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:07.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.170459 23480 ts_tablet_manager.cc:1403] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.008s
12:16:07.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.170771 23492 leader_election.cc:290] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.173910 23480 raft_consensus.cc:359] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:07.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.174587 23480 raft_consensus.cc:385] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.174873 23480 raft_consensus.cc:740] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:07.175 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:07.175 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:07.175 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:07.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.176 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.175449 23480 consensus_queue.cc:260] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:07.176 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.176 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.176 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.176 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.176 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.176 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:07.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.183678 23480 ts_tablet_manager.cc:1434] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
12:16:07.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.184558 23480 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82: Bootstrap starting.
12:16:07.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.201741 23480 tablet_bootstrap.cc:654] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82: Neither blocks nor log segments found. Creating new log.
12:16:07.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.209057 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ddb05d5d1045b5908e623a2aa560cf" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82"
12:16:07.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.209688 22860 raft_consensus.cc:3060] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.210333 23484 leader_election.cc:290] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 election: Requested vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.217446 22860 raft_consensus.cc:2468] T b7ddb05d5d1045b5908e623a2aa560cf P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 1.
12:16:07.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.218755 23223 leader_election.cc:304] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82; no voters: 
12:16:07.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.220568 23480 tablet_bootstrap.cc:492] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82: No bootstrap required, opened a new log
12:16:07.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.221006 23480 ts_tablet_manager.cc:1403] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
12:16:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.224105 23480 raft_consensus.cc:359] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.224776 23480 raft_consensus.cc:385] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.225067 23480 raft_consensus.cc:740] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Initialized, Role: FOLLOWER
12:16:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.225865 23480 consensus_queue.cc:260] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.233862 23480 ts_tablet_manager.cc:1434] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
12:16:07.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.237097 23484 raft_consensus.cc:2804] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.241120 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ddb05d5d1045b5908e623a2aa560cf" candidate_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:07.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.241799 23095 raft_consensus.cc:3060] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.242375 23484 raft_consensus.cc:697] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 LEADER]: Becoming Leader. State: Replica: 2b5802e7d4c448dfb93dd1bfb573d384, State: Running, Role: LEADER
12:16:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.248828 23484 consensus_queue.cc:237] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.252665 23095 raft_consensus.cc:2468] T b7ddb05d5d1045b5908e623a2aa560cf P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b5802e7d4c448dfb93dd1bfb573d384 in term 1.
12:16:07.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.258533 23496 raft_consensus.cc:493] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.258989 23496 raft_consensus.cc:515] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.262086 23496 leader_election.cc:290] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.275 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:07.275 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:07.275 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:07.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.275188 23490 tablet_bootstrap.cc:654] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:07.275 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.276 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.276 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.276 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.276 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:07.306 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:07.306 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:07.307 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:07.307 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:16:07.307 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.307 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.308 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.308 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:16:07.308 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.308 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.308 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.308 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:16:07.308 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.308 [INFO - flink-pekko.actor.default-dispatcher-4] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:07.308 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.308 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.308 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:07.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.309505 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:07.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.309945 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:07.313 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to SCHEDULED.
12:16:07.314 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from SCHEDULED to DEPLOYING.
12:16:07.314 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #6) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:16:07.314 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to SCHEDULED.
12:16:07.315 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from SCHEDULED to DEPLOYING.
12:16:07.315 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #6) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:16:07.315 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
12:16:07.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:07.315173 22793 leader_election.cc:343] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:07.315 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
12:16:07.315 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:16:07.316 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to SCHEDULED.
12:16:07.316 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from SCHEDULED to DEPLOYING.
12:16:07.316 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #6) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:16:07.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:07.316133 22793 leader_election.cc:343] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:07.318 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:16:07.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.317375 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.318110 23289 raft_consensus.cc:2468] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 0.
12:16:07.319 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:16:07.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.316169 22585 catalog_manager.cc:5697] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131). New cstate: current_term: 1 leader_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: HEALTHY } } }
12:16:07.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.323179 23029 leader_election.cc:304] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 
12:16:07.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.324071 23492 raft_consensus.cc:2804] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:07.324 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:07.325 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:07.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.324424 23492 raft_consensus.cc:493] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:07.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.324815 23492 raft_consensus.cc:3060] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.325 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:07.325 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:07.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.332799 23492 raft_consensus.cc:515] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.334 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:07.334 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:07.334 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:07.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.335 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:07.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.337252 23492 leader_election.cc:290] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 election: Requested vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.338485 23289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.339025 23289 raft_consensus.cc:3060] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.347087 23490 tablet_bootstrap.cc:492] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:07.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.347533 23490 ts_tablet_manager.cc:1403] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.210s	user 0.005s	sys 0.005s
12:16:07.349 [INFO - Thread-57] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:07.349 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:16:07.358 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:16:07.358 [DEBUG - Thread-57] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:16:07.358 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:07.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.359182 23289 raft_consensus.cc:2468] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 1.
12:16:07.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.359540 23496 raft_consensus.cc:493] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.359982 23496 raft_consensus.cc:515] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.360528 23029 leader_election.cc:304] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384; no voters: 
12:16:07.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.361930 23496 leader_election.cc:290] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.362 [INFO - Thread-57] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:07.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.362479 23492 raft_consensus.cc:2804] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.363690 23288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.364307 23288 raft_consensus.cc:2468] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c08d351c2d48108b4850a050167e82 in term 0.
12:16:07.365 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:16:07.365 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:16:07.362 [INFO - Thread-57] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:07.368 [DEBUG - Thread-57] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:07.368 [INFO - Thread-57] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:07.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CREATED to DEPLOYING.
12:16:07.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) [DEPLOYING].
12:16:07.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f463087
12:16:07.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:07.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:07.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.365455 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.365473 22793 leader_election.cc:304] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82; no voters: 035e9dc71535495dad5692c3f75985a8
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.366125 23287 raft_consensus.cc:2468] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c08d351c2d48108b4850a050167e82 in term 0.
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.367050 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.367211 22793 leader_election.cc:304] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82; no voters: 035e9dc71535495dad5692c3f75985a8
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.368135 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.368993 23286 raft_consensus.cc:2393] T 28ba685ff6104af184a6435f42a45254 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c08d351c2d48108b4850a050167e82 in current term 1: Already voted for candidate 035e9dc71535495dad5692c3f75985a8 in this term.
12:16:07.370 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from DEPLOYING to INITIALIZING.
12:16:07.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.373829 23490 raft_consensus.cc:359] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.375 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:16:07.376 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:16:07.377 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from CREATED to DEPLOYING.
12:16:07.377 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) [DEPLOYING].
12:16:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.376153 23496 raft_consensus.cc:2804] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.376277 23492 raft_consensus.cc:697] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [term 1 LEADER]: Becoming Leader. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Running, Role: LEADER
12:16:07.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.376614 23496 raft_consensus.cc:493] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:07.377 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@9e52741
12:16:07.378 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:07.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.377624 23492 consensus_queue.cc:237] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.377032 23496 raft_consensus.cc:3060] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.380825 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:07.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.381515 23490 raft_consensus.cc:385] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.381690 22860 raft_consensus.cc:2468] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 0.
12:16:07.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.382465 23490 raft_consensus.cc:740] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:07.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.383474 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ba685ff6104af184a6435f42a45254" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82"
12:16:07.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.384187 22859 raft_consensus.cc:3060] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.384 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:07.385 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
12:16:07.385 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from DEPLOYING to INITIALIZING.
12:16:07.386 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@35b4d751
12:16:07.389 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:16:07.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.384569 23490 consensus_queue.cc:260] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.390 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:16:07.391 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
12:16:07.391 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
12:16:07.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4bf87184
12:16:07.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:07.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:07.392 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:16:07.392 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:16:07.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.394765 22859 raft_consensus.cc:2468] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 1.
12:16:07.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.396451 23530 raft_consensus.cc:2804] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:07.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.397501 23530 raft_consensus.cc:493] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:07.399 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:07.400 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2dd43fd9
12:16:07.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.400465 23530 raft_consensus.cc:3060] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.402011 23490 ts_tablet_manager.cc:1434] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.004s
12:16:07.403 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:07.404 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from CREATED to DEPLOYING.
12:16:07.404 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) [DEPLOYING].
12:16:07.404 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@75b6071b
12:16:07.405 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:07.405 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:07.405 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
12:16:07.405 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from DEPLOYING to INITIALIZING.
12:16:07.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.407145 23530 raft_consensus.cc:515] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.404551 23490 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8: Bootstrap starting.
12:16:07.410 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@474a63f1
12:16:07.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.413904 23484 consensus_queue.cc:1048] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.417 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:07.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.420110 22585 catalog_manager.cc:5697] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 035e9dc71535495dad5692c3f75985a8 (127.21.224.130). New cstate: current_term: 1 leader_uuid: "035e9dc71535495dad5692c3f75985a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: UNKNOWN } } }
12:16:07.425 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3433c94e
12:16:07.425 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:07.425 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:07.425 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:07.426 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:07.435 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:07.435 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:07.435 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:07.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:07.436 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.436 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.436 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:07.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:07.436 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.403110 23496 raft_consensus.cc:515] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.418754 22793 leader_election.cc:304] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c08d351c2d48108b4850a050167e82; no voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384
12:16:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.444351 23496 leader_election.cc:290] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 election: Requested vote from peers 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.444927 23496 raft_consensus.cc:2749] T 28ba685ff6104af184a6435f42a45254 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:07.447 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.450 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.452 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.452327 23530 leader_election.cc:290] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 election: Requested vote from peers 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.453 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:07.455 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.456 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:07.457 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:07.457 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:07.457 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#6] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:07.457 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:07.457 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:07.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:07.457 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:07.457 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.457 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:07.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:07.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:07.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:07.458 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:07.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.458 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.458 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.461606 23095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.462147 23095 raft_consensus.cc:3060] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.464 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.468 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.465176 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.465705 23287 raft_consensus.cc:3060] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.466410 23094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8"
12:16:07.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.468442 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f99869ee7148fdbe17c4cdb611c839" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:07.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.469730 23286 raft_consensus.cc:3060] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:07.472527 22793 leader_election.cc:343] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Illegal state: must be running to vote when last-logged opid is not known
12:16:07.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.476827 22859 raft_consensus.cc:3060] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.485548 23503 consensus_queue.cc:1048] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:16:07.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.487058 23287 raft_consensus.cc:2468] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c08d351c2d48108b4850a050167e82 in term 1.
12:16:07.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.490116 23286 raft_consensus.cc:2468] T 50f99869ee7148fdbe17c4cdb611c839 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c08d351c2d48108b4850a050167e82 in term 1.
12:16:07.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.488389 22793 leader_election.cc:304] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82; no voters: 035e9dc71535495dad5692c3f75985a8
12:16:07.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.491094 23490 tablet_bootstrap.cc:654] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8: Neither blocks nor log segments found. Creating new log.
12:16:07.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.492251 22793 leader_election.cc:304] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82; no voters: 
12:16:07.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.492822 23530 raft_consensus.cc:493] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.493696 23530 raft_consensus.cc:515] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } }
12:16:07.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.495659 23530 leader_election.cc:290] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413), 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235)
12:16:07.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.496192 23530 raft_consensus.cc:2804] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.496783 23530 raft_consensus.cc:697] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [term 1 LEADER]: Becoming Leader. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Running, Role: LEADER
12:16:07.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.497761 23530 consensus_queue.cc:237] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.498317 23492 raft_consensus.cc:493] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.498824 23492 raft_consensus.cc:515] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.501477 23492 leader_election.cc:290] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.500102 23496 raft_consensus.cc:2804] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.502385 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:07.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.502993 22860 raft_consensus.cc:2468] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 0.
12:16:07.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.503901 23095 raft_consensus.cc:2468] T 50f99869ee7148fdbe17c4cdb611c839 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c08d351c2d48108b4850a050167e82 in term 1.
12:16:07.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.504024 23093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "035e9dc71535495dad5692c3f75985a8" is_pre_election: true
12:16:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.505544 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.505816 23030 leader_election.cc:304] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 47c08d351c2d48108b4850a050167e82; no voters: 
12:16:07.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.506559 23492 raft_consensus.cc:2804] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:07.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.506910 23492 raft_consensus.cc:493] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:07.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.507220 23492 raft_consensus.cc:3060] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.514640 23287 raft_consensus.cc:2468] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 0.
12:16:07.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.512089 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed12c303849ad88879ee51f1e65d5" candidate_uuid: "47c08d351c2d48108b4850a050167e82" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.517002 23496 raft_consensus.cc:697] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [term 1 LEADER]: Becoming Leader. State: Replica: 47c08d351c2d48108b4850a050167e82, State: Running, Role: LEADER
12:16:07.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.517939 23496 consensus_queue.cc:237] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.525286 22793 leader_election.cc:304] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c08d351c2d48108b4850a050167e82; no voters: 035e9dc71535495dad5692c3f75985a8, 2b5802e7d4c448dfb93dd1bfb573d384
12:16:07.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.520670 23492 raft_consensus.cc:515] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.539497 23492 leader_election.cc:290] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 election: Requested vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.540566 23286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384"
12:16:07.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.541263 23286 raft_consensus.cc:3060] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.542693 22860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd95f899c3fc422bb6d028773bf76481" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82"
12:16:07.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.543200 22860 raft_consensus.cc:3060] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.549830 22860 raft_consensus.cc:2468] T bd95f899c3fc422bb6d028773bf76481 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 1.
12:16:07.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.551047 23030 leader_election.cc:304] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8, 47c08d351c2d48108b4850a050167e82; no voters: 
12:16:07.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.556733 23492 raft_consensus.cc:2804] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader election won for term 1
12:16:07.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.559118 23492 raft_consensus.cc:697] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [term 1 LEADER]: Becoming Leader. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Running, Role: LEADER
12:16:07.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.562652 23286 raft_consensus.cc:2468] T bd95f899c3fc422bb6d028773bf76481 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 035e9dc71535495dad5692c3f75985a8 in term 1.
12:16:07.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.561012 23492 consensus_queue.cc:237] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.574589 22586 catalog_manager.cc:5697] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 035e9dc71535495dad5692c3f75985a8 (127.21.224.130). New cstate: current_term: 1 leader_uuid: "035e9dc71535495dad5692c3f75985a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: UNKNOWN } } }
12:16:07.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.586526 22585 catalog_manager.cc:5697] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c08d351c2d48108b4850a050167e82 (127.21.224.129). New cstate: current_term: 1 leader_uuid: "47c08d351c2d48108b4850a050167e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: UNKNOWN } } }
12:16:07.615 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.616 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.616 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.616 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.618 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:07.618 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:07.618 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:07.619 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.619 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.619 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.619 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.619 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.619 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.619 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.619 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:07.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.623602 23490 tablet_bootstrap.cc:492] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8: No bootstrap required, opened a new log
12:16:07.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.624249 23490 ts_tablet_manager.cc:1403] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.003s
12:16:07.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.624380 23549 raft_consensus.cc:2749] T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
12:16:07.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.627269 23490 raft_consensus.cc:359] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.634 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:07.634 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:07.635 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:07.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:07.636 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.636 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.636 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:07.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:07.636 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:07.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.628021 23490 raft_consensus.cc:385] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:07.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.628295 23490 raft_consensus.cc:740] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 035e9dc71535495dad5692c3f75985a8, State: Initialized, Role: FOLLOWER
12:16:07.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.629150 23490 consensus_queue.cc:260] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.631572 22585 catalog_manager.cc:5697] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c08d351c2d48108b4850a050167e82 (127.21.224.129). New cstate: current_term: 1 leader_uuid: "47c08d351c2d48108b4850a050167e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } health_report { overall_health: UNKNOWN } } }
12:16:07.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.636804 23490 ts_tablet_manager.cc:1434] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
12:16:07.661 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.662 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.663 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.663 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.663 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:07.667780 22570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.224.188:40821, user_credentials={real_user=slave}} blocked reactor thread for 53999.8us
12:16:07.682 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#6] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.682 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.683 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.683 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.683 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.683 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.684 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.684 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.684 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.685 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.685 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.685 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.686 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.686 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.687 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.687 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.688 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.688 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.688 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.688 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.689 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.689 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.689 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.689 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.690 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.688566 23484 consensus_queue.cc:1048] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:16:07.690 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.690 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.691 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.692 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.692 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.695 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.699 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.699 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.700 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.700 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.700 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.700 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.700 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.701 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.701 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.701 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:07.708 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.708 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.709 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.709 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.710 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.710 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.710 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.725 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.728113 23504 consensus_queue.cc:1048] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.745 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.745 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.745 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.746 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.750 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.773 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#6] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.775 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.189:35221(127.21.36.189:35221)] disconnecting while in state READY
12:16:07.775 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.190:33455(127.21.36.190:33455)] disconnecting while in state READY
12:16:07.775 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.188:41809(127.21.36.188:41809)] disconnecting while in state READY
12:16:07.776 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.36.189:35221(127.21.36.189:35221)] handling channelInactive
12:16:07.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state READY due to: connection closed
12:16:07.776 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.36.190:33455(127.21.36.190:33455)] handling channelInactive
12:16:07.776 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state READY due to: connection closed
12:16:07.777 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:07.778 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-0
12:16:07.778 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-1
12:16:07.781 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.781 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.781 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.781 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.784 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.785 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.786 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.786 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.786 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.786 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.787 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.787 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.787 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.797 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.797 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.797 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.797 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.797 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.797 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.797 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.797 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.797 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.798 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.798 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.798 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.798 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.799 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.799 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.799 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.799 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.800 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.800 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.800 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.800 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.801 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.801 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.801 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.801 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.36.188:41809(127.21.36.188:41809)] handling channelInactive
12:16:07.801 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.802 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state READY due to: connection closed
12:16:07.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.802 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:16:07.802 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.190:35543(127.21.224.190:35543)] disconnecting while in state READY
12:16:07.802 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.188:40821(127.21.224.188:40821)] disconnecting while in state READY
12:16:07.802 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.189:39039(127.21.224.189:39039)] disconnecting while in state READY
12:16:07.803 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.803 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.803 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.803 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:07.803 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:07.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.803 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.804 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:07.802 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.803 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:07.806 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:07.806 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:16:07.807 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:16:07.808 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.808 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.809 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.809 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.809 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.809 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.810 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.810 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.810 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.810 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.812 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.813 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.813 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.813 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.813 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.813 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.813 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.813 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.813 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.813 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.813 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.814 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.814 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.814 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.814 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.815 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.815 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.815 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.815 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.815 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.815 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.815 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:07.816 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.816 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.816 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.816 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.817 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:07.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:07.817 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
12:16:07.818 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:07.819 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:16:07.819 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:16:07.819 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:07.819 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:07.819 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:07.822 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.823 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:07.825 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.826 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.826 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.826 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.826242 23492 consensus_queue.cc:1048] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.826 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.827 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.827 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.827 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.827 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.827 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.827 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.828 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.828 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.828 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.828 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.828 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.828 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.828 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.828 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.828 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.828 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.828 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.829 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.829 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.828 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.829 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.829 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.829 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.829 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.829 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.829 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.829 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.829 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.829 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.829 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.830 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.830 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.830 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.830 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.830 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.830 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.830 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.830 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.831 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.831 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.829 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.830 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.833 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.833 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.837 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.837 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.846 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.846 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.846 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.846 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.846 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.847 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.847 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.847 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.847 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.847 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.848 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.848 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.849 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.849 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.849 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.849 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.849 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.849 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.849 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.849 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.851 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.851 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.851 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.851 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.851 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.851 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.851 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.851 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.851 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.851 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.852 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.852 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.852 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.853 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.854 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.854 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.854 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.854 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.854 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.855 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.855 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.855 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.855 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.859570 23492 consensus_queue.cc:1048] T 28ba685ff6104af184a6435f42a45254 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.865 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.865 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.865 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.865 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.866 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.866 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.873 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.873 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.873 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.873 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.873 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.873 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.873 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.874 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.874 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.874 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.874 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.874 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.874 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.889 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.889 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.889 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.891 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.891 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.891 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.891 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.891 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.892 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.892 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.892 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.892 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.892 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.892 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.892 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.893 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.893 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.893 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.894 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.894 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.895 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.895 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.893527 23528 raft_consensus.cc:493] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:07.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.894034 23528 raft_consensus.cc:515] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 } } peers { permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 } } peers { permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 } }
12:16:07.895 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.895 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.895 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.895 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.896 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.896 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.896 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.896 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.897357 23528 leader_election.cc:290] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357), 2b5802e7d4c448dfb93dd1bfb573d384 (127.21.224.131:37413)
12:16:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.898516 23287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" is_pre_election: true
12:16:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.899250 23287 raft_consensus.cc:2393] T 16a96b2aa0de460b91f73b91837cd938 P 2b5802e7d4c448dfb93dd1bfb573d384 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 035e9dc71535495dad5692c3f75985a8 in current term 1: Already voted for candidate 47c08d351c2d48108b4850a050167e82 in this term.
12:16:07.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.899940 22859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a96b2aa0de460b91f73b91837cd938" candidate_uuid: "035e9dc71535495dad5692c3f75985a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c08d351c2d48108b4850a050167e82" is_pre_election: true
12:16:07.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.901638 23029 leader_election.cc:304] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 035e9dc71535495dad5692c3f75985a8; no voters: 2b5802e7d4c448dfb93dd1bfb573d384, 47c08d351c2d48108b4850a050167e82
12:16:07.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.913415 23492 raft_consensus.cc:3060] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 0 FOLLOWER]: Advancing to term 1
12:16:07.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.917 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.917 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.917 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.920310 23492 raft_consensus.cc:2749] T 16a96b2aa0de460b91f73b91837cd938 P 035e9dc71535495dad5692c3f75985a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
12:16:07.925 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.927 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.927 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.927 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.927 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:07.928 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.928 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.928 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.928 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.928 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.929 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.929 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.929 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.929 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.929 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.929 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.929 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.929 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.933 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:07.933 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:07.933 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:07.934 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.934 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.934 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:07.934 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.934 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.934 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:07.934 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.934 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.934 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:07.934 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:07.937 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:16:07.938 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:16:07.938 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:16:07.938 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:16:07.938 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:16:07.938 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:16:07.938 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:16:07.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.942 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.943 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.943 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.942 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.943 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.943 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.943 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.943 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.943 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:07.944 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.944 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.944 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.944 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.944 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.944 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.945 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.945 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.945 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.945 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.944 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.945 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.953 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.954 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.954 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.954 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.954 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.954 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.954 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.955 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.955 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.955 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.955 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.955 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.963 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.963 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.963 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.963 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.963 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.963 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.963 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.963 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.963 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.963 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:07.965 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:07.965 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:07.965 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:07.965 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.965 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.965 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:07.965 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.965 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.965 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:07.966 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.966 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.966 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:07.966 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:07.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.969038 23549 consensus_queue.cc:1048] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:07.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:07.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:07.974 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.974 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.974 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:07.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:07.976 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.976 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.976 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:07.976 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:07.981 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:07.981 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:07.982 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:07.983 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.983 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.983 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:07.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:07.982219 23549 consensus_queue.cc:1048] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:07.984 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.984 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.984 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:07.984 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.984 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.984 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:07.984 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:08.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.011 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.011 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.011 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.012 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.012 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.012 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.024 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:08.024 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:08.024 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:08.025 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.025 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.025 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.025 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.025 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.025 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.026 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.026 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.026 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.026 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:08.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:08.026698 23496 consensus_queue.cc:1048] T 16a96b2aa0de460b91f73b91837cd938 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:08.033 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.033 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.033 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.033 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.033 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.033 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.034 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.034 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.034 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.034 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.034 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.034 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.034 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.045 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.045 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.045 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.045 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.045 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.045 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.046 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.046 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.046 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.046 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.046 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.046 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.046 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.055 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:08.055 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:08.055 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:08.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.056 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.056 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.056 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.057 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.057 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.057 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:08.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:08.060125 23549 consensus_queue.cc:1048] T 50f99869ee7148fdbe17c4cdb611c839 P 47c08d351c2d48108b4850a050167e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "035e9dc71535495dad5692c3f75985a8" member_type: VOTER last_known_addr { host: "127.21.224.130" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:08.084 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.085 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.085 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.085 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.085 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.086 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.086 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.086 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.086 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.086 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.087 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.088 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.088 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.088 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.088 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.088 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.088 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.088 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.088 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.088 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.088 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.088 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.088 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:08.116911 23528 consensus_queue.cc:1048] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b5802e7d4c448dfb93dd1bfb573d384" member_type: VOTER last_known_addr { host: "127.21.224.131" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:08.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:08.121963 23528 consensus_queue.cc:1048] T bd95f899c3fc422bb6d028773bf76481 P 035e9dc71535495dad5692c3f75985a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c08d351c2d48108b4850a050167e82" member_type: VOTER last_known_addr { host: "127.21.224.129" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:08.130 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.130 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.130 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.130 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.131 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.131 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.131 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.131 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.142 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:08.142 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:08.142 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:08.142 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.142 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.142 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.143 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.143 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.143 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.143 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.143 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.143 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.143 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:08.154 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:08.154 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:08.154 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:08.155 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:08.155 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:08.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:08.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:08.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:08.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:08.156 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:08.156 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:08.156 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:08.156 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:08.205 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.205 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.205 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.206 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.206 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.206 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.206 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.206 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.206 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.206 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.210 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.210 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.210 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.211 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.211 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.211 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.211 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.211 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.211 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.262 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:08.262 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:08.262 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:08.262 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.262 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.263 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.263 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.263 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.263 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.263 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.263 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.263 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.263 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:08.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.292 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.293 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.293 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.293 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.293 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.293 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.293 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.293 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.293 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.294 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.294 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.294 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.294 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.435 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:16:08.454 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:08.455 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:08.455 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:08.455 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.456 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.456 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.456 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.457 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:08.473 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.473 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.473 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.474 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.474 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.474 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.474 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.474 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.474 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.475 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.499 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:16:08.499 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:16:08.499 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:16:08.511 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:16:08.592 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.593 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.593 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.593 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.597 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.597 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.597 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.597 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.597 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.597 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.597 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.597 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.597 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.597 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.633 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:08.634 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:08.634 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:08.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.634 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.634 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.634 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.634 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:08.681 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:08.681 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:08.681 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:08.681 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:08.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:08.682 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:08.682 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:08.702 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:08.702 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:08.702 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:08.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.703 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.703 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:08.703 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.703 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.703 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.703 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:08.703 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:08.703 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:08.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:08.891 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:08.891 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:08.892 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:08.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:08.892 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.892 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.892 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:08.892 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.892 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.893 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:08.893 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:08.914 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:08.915 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:08.915 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:08.915 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.915 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.915 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:08.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:08.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.916 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:08.916 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:08.977 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:08.977 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:08.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:08.979 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:08.979 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:08.979 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:08.979 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:08.980 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:08.980 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:08.980 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:08.980 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:08.980 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:08.980 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:09.015 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:09.015 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:09.015 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:09.015 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:09.015 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:09.015 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:09.015 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:09.015 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:09.016 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:09.016 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:09.016 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:09.016 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:09.016 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:09.017 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:09.017 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:09.017 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:09.017 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.017 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.017 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.018 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.018 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.018 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.018 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:09.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.054 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:09.055 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:09.055 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:09.055 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.055 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.055 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.056 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.056 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.056 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.056 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.056 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:09.084 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:09.085 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:09.085 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:09.085 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.085 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.085 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.086 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.086 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.086 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.086 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.086 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.086 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:09.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.153 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:09.153 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:09.154 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:09.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.155 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.155 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.155 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.155 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.155 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.156 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:09.164 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:09.165 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:09.165 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:09.165 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.165 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.165 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.166 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.166 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.166 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.166 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.166 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.166 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.166 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:09.195 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:09.195 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:09.195 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:09.195 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.195 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.195 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:09.196 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.196 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.196 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:09.196 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.196 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.196 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:09.196 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:09.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.270 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:09.270 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:09.270 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:09.271 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.271 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.271 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.271 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.271 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.271 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.271 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.271 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.271 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.271 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:09.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.305 [INFO - flink-pekko.actor.default-dispatcher-5] (Slf4jLogger.scala:117) Slf4jLogger started
12:16:09.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.361 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:09.361 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:09.361 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:09.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:09.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:09.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:09.362 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:09.362 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:09.362 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:09.362 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:09.362 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:09.362 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:09.362 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:09.452 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:16:09.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:09.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:09.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:09.463 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.463 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.463 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:09.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:09.464 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.464 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.464 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:09.464 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:09.465 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:16:09.494 [INFO - flink-metrics-6] (Slf4jLogger.scala:117) Slf4jLogger started
12:16:09.507 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:16:09.520 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:16:09.525 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:16:09.526 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:16:09.526 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:16:09.526 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:16:09.527 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:16:09.527 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:16:09.527 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:16:09.527 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:16:09.527 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:16:09.527 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:16:09.528 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:16:09.528 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:16:09.528 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:16:09.528 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:16:09.528 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:16:09.528 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:16:09.528 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:16:09.528 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:16:09.528 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:16:09.529 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:16:09.529 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:16:09.529 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:16:09.529 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:16:09.529 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:16:09.529 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_6513e5defb4d0ccf6e98e528ebd8bc35/blobStorage
12:16:09.530 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:43109 - max concurrent requests: 50 - max backlog: 1000
12:16:09.531 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6513e5defb4d0ccf6e98e528ebd8bc35/blobStorage
12:16:09.532 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_6513e5defb4d0ccf6e98e528ebd8bc35/blobStorage
12:16:09.532 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:16:09.533 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae
12:16:09.534 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:16:09.535 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-efab2892-71a9-427e-8e3d-8e4608ae0ad7
12:16:09.536 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-9b2e0c5e-32c1-4051-b10c-fe07af9d79e3
12:16:09.551 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:09.552 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:09.552 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:09.552 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.552 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.552 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.552 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.552 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.553 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.552 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.553 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.553 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.553 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:09.564 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:09.564 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:09.564 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:09.565 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.565 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.565 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:09.565 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.566 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.566 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:09.566 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.566 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.566 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:09.566 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:09.621 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.642 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:16:09.642 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:16:09.642 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:16:09.642 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:16:09.643 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:16:09.646 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_20 .
12:16:09.652 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:16:09.653 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultJobLeaderService.java:127) Start job leader service.
12:16:09.653 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:16:09.653 [INFO - flink-pekko.actor.default-dispatcher-5] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-44c8230c-b160-4f06-8da3-acf7174a0766
12:16:09.661 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:16:09.661 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:16:09.669 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:39959
12:16:09.670 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:16:09.670 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:09.670 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:09.670 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:09.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:09.670 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:09.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:09.670 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:09.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:09.670 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:09.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:09.670 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:09.671 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:09.671 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:09.681 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:39959 was granted leadership with leaderSessionID=41a6d3f4-fe52-4a47-af70-19db72f62e19
12:16:09.681 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:39959 , session=41a6d3f4-fe52-4a47-af70-19db72f62e19
12:16:09.682 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:16:09.683 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:16:09.683 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:16:09.683 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 98040bd1-609c-4232-a24d-14483298b963. Creating new DispatcherLeaderProcess.
12:16:09.683 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:16:09.684 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:16:09.684 [INFO - pool-393-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id 96daadb2-94fc-49e8-af2f-a10494b4137e.
12:16:09.684 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:16:09.684 [INFO - mini-cluster-io-thread-1] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:16:09.688 [INFO - mini-cluster-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_21 .
12:16:09.695 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_21 , session=98040bd1-609c-4232-a24d-14483298b963
12:16:09.699 [INFO - pool-393-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_22 .
12:16:09.705 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:253) Starting the resource manager.
12:16:09.705 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:16:09.705 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:16:09.706 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:16:09.706 [WARN - flink-pekko.actor.default-dispatcher-5] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:16:09.706 [INFO - mini-cluster-io-thread-4] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_22 , session=96daadb2-94fc-49e8-af2f-a10494b4137e
12:16:09.719 [INFO - flink-pekko.actor.default-dispatcher-5] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(af2fa10494b4137e96daadb294fc49e8).
12:16:09.726 [INFO - flink-pekko.actor.default-dispatcher-5] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:16:09.733 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:1080) Registering TaskManager with ResourceID 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae (pekko://flink/user/rpc/taskmanager_20) at ResourceManager
12:16:09.733 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_22 under registration id e3df19f08ef0e55041b17a8152f00955.
12:16:09.734 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.734 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:344) Registering task executor 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae under e3df19f08ef0e55041b17a8152f00955 at the slot manager.
12:16:09.734 [INFO - flink-pekko.actor.default-dispatcher-5] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.734 [INFO - flink-pekko.actor.default-dispatcher-5] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-1ca37d58d1e10dcfad9f21d692b10dbc'.
12:16:09.735 [INFO - mini-cluster-io-thread-2] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job 1ca37d58d1e10dcfad9f21d692b10dbc was granted leadership with leader id 18778b31-3faa-45b7-9c1e-34b7ea3a7d36. Creating new JobMasterServiceProcess.
12:16:09.736 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_23 .
12:16:09.740 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.741 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.741 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph 6b58d362473e582c2c5e5deb16d39e3b for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.741 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.742 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:16:09.742 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:16:09.743 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b7366dd
12:16:09.743 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:09.743 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:09.744 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:16:09.744 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@7530f1f7 for Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc).
12:16:09.744 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_23 , session=18778b31-3faa-45b7-9c1e-34b7ea3a7d36
12:16:09.745 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (1ca37d58d1e10dcfad9f21d692b10dbc) under job master id 9c1e34b7ea3a7d3618778b313faa45b7.
12:16:09.745 [INFO - flink-pekko.actor.default-dispatcher-5] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:09.747 [DEBUG - flink-pekko.actor.default-dispatcher-5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:09.748 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:16:09.748 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc) switched from state CREATED to RUNNING.
12:16:09.749 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:16:09.749 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:16:09.749 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:16:09.750 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:16:09.750 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:09.750 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_22(af2fa10494b4137e96daadb294fc49e8)
12:16:09.750 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:09.751 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.36.190:33455(127.21.36.190:33455)] Successfully connected to peer
12:16:09.752 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:09.752 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.36.189:35221(127.21.36.189:35221)] Successfully connected to peer
12:16:09.752 [INFO - flink-pekko.actor.default-dispatcher-9] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:16:09.753 [INFO - flink-pekko.actor.default-dispatcher-8] (ResourceManager.java:390) Registering job manager 9c1e34b7ea3a7d3618778b313faa45b7@pekko://flink/user/rpc/jobmanager_23 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.756 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.190
12:16:09.758 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.189
12:16:09.759 [INFO - flink-pekko.actor.default-dispatcher-5] (ResourceManager.java:1015) Registered job manager 9c1e34b7ea3a7d3618778b313faa45b7@pekko://flink/user/rpc/jobmanager_23 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.766 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.769 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.36.188:41809(127.21.36.188:41809)] Successfully connected to peer
12:16:09.769 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.770 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc316ee47, L:/127.0.0.1:52432 - R:/127.21.36.190:33455] using SASL/PLAIN
12:16:09.772 [INFO - flink-pekko.actor.default-dispatcher-5] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: af2fa10494b4137e96daadb294fc49e8.
12:16:09.773 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 1ca37d58d1e10dcfad9f21d692b10dbc: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:09.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.774 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb604a6f2, L:/127.0.0.1:55076 - R:/127.21.36.189:35221] using SASL/PLAIN
12:16:09.774 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:09.774 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=24), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: OK, deferred=null) after lookup
12:16:09.777 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:09.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:09.784 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:09.788 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:09.789 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:09.790 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:09.794 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:09.795 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.188
12:16:09.800 [DEBUG - main] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:09.801 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:09.832 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.834 [INFO - flink-pekko.actor.default-dispatcher-5] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job 1ca37d58d1e10dcfad9f21d692b10dbc
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:16:09.835 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:09.835 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 4e10753ea3e92c7d4ed2a7070c819ee7 from 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae for job 1ca37d58d1e10dcfad9f21d692b10dbc with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.836 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 1d214d15f047c66ca8c8768322c43f15 from 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae for job 1ca37d58d1e10dcfad9f21d692b10dbc with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.836 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 4e10753ea3e92c7d4ed2a7070c819ee7 for job 1ca37d58d1e10dcfad9f21d692b10dbc from resource manager with leader id af2fa10494b4137e96daadb294fc49e8.
12:16:09.836 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot ddf2e55cd94f4a8bcb30013f29fde10e from 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae for job 1ca37d58d1e10dcfad9f21d692b10dbc with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.836 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 4e10753ea3e92c7d4ed2a7070c819ee7 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.836 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 2aaa0a7fd6e3534a1b8cefc39b0acf24 from 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae for job 1ca37d58d1e10dcfad9f21d692b10dbc with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.837 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:09.838 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:09.839 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfbda8fda, L:/127.0.0.1:50378 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:09.844 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.846 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.849 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xdaa07bf6, L:/127.0.0.1:58762 - R:/127.21.36.188:41809] using SASL/PLAIN
12:16:09.851 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa3257b09, L:/127.0.0.1:58344 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:09.859 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultJobLeaderService.java:192) Add job 1ca37d58d1e10dcfad9f21d692b10dbc for job leader monitoring.
12:16:09.859 [INFO - mini-cluster-io-thread-2] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_23 with leader id 18778b31-3faa-45b7-9c1e-34b7ea3a7d36.
12:16:09.859 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 1d214d15f047c66ca8c8768322c43f15 for job 1ca37d58d1e10dcfad9f21d692b10dbc from resource manager with leader id af2fa10494b4137e96daadb294fc49e8.
12:16:09.859 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 1d214d15f047c66ca8c8768322c43f15 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.860 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request ddf2e55cd94f4a8bcb30013f29fde10e for job 1ca37d58d1e10dcfad9f21d692b10dbc from resource manager with leader id af2fa10494b4137e96daadb294fc49e8.
12:16:09.860 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for ddf2e55cd94f4a8bcb30013f29fde10e with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.860 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:1149) Receive slot request 2aaa0a7fd6e3534a1b8cefc39b0acf24 for job 1ca37d58d1e10dcfad9f21d692b10dbc from resource manager with leader id af2fa10494b4137e96daadb294fc49e8.
12:16:09.860 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:321) Allocated slot for 2aaa0a7fd6e3534a1b8cefc39b0acf24 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:09.861 [INFO - flink-pekko.actor.default-dispatcher-7] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:16:09.863 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_23 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.863 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1783) Establish JobManager connection for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.863 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1633) Offer reserved slots to the leader of job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.864 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:16:09.864 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1) with allocation id 4e10753ea3e92c7d4ed2a7070c819ee7
12:16:09.865 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4e10753ea3e92c7d4ed2a7070c819ee7.
12:16:09.866 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:09.866 [INFO - flink-pekko.actor.default-dispatcher-9] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:16:09.866 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id 1ca37d58d1e10dcfad9f21d692b10dbc
12:16:09.867 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 4e10753ea3e92c7d4ed2a7070c819ee7.
12:16:09.867 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:09.871 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:16:09.871 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1) with allocation id 1d214d15f047c66ca8c8768322c43f15
12:16:09.874 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:09.874 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:09.875 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:09.875 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.875 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.875 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.875 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:09.876 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.876 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.876 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:09.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:09.876 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:09.879 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xb583c34a, L:/127.0.0.1:39496 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:09.881 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:16:09.881 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1) with allocation id 2aaa0a7fd6e3534a1b8cefc39b0acf24
12:16:09.882 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:16:09.882 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1) with allocation id ddf2e55cd94f4a8bcb30013f29fde10e
12:16:09.882 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:09.883 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=95), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [55ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.188:40821: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.190:35543: OK, [94ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:09.886 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:09.891 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1d214d15f047c66ca8c8768322c43f15.
12:16:09.891 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:09.891 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:09.891 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:09.891 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:09.892 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:09.892 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:09.892 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 1d214d15f047c66ca8c8768322c43f15.
12:16:09.893 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299998}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299998, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299998}]
12:16:09.893 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=6), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.224.189:39039, [5ms] Sub RPC GetTableLocations: received response from server master-127.21.224.189:39039: OK, deferred=null)) after lookup
12:16:09.893 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] connecting to peer
12:16:09.895 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:16:09.895 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:16:09.898 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f80f374
12:16:09.899 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:09.899 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:09.899 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:16:09.900 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:16:09.903 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2aaa0a7fd6e3534a1b8cefc39b0acf24.
12:16:09.904 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id 2aaa0a7fd6e3534a1b8cefc39b0acf24.
12:16:09.905 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:16:09.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:16:09.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6b07caf7
12:16:09.906 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:09.912 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:09.912 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:16:09.913 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:16:09.916 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1319eeee
12:16:09.919 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:09.922 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3acc6085
12:16:09.933 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:09.937 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot ddf2e55cd94f4a8bcb30013f29fde10e.
12:16:09.938 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id ddf2e55cd94f4a8bcb30013f29fde10e.
12:16:09.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:16:09.941 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:16:09.942 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@48a906b6
12:16:09.942 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:09.942 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:09.942 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 4e10753ea3e92c7d4ed2a7070c819ee7.
12:16:09.942 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 1d214d15f047c66ca8c8768322c43f15.
12:16:09.942 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot 2aaa0a7fd6e3534a1b8cefc39b0acf24.
12:16:09.942 [INFO - flink-pekko.actor.default-dispatcher-9] (TaskSlotTableImpl.java:391) Activate slot ddf2e55cd94f4a8bcb30013f29fde10e.
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:16:09.943 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@359b3dab
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:09.943 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:09.944 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:16:09.944 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:16:09.954 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2eb8c832
12:16:09.955 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:09.956 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cfb8921
12:16:09.957 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:09.958 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:09.965 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:09.970 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:09.971 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:09.972 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] Successfully connected to peer
12:16:09.978 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:09.979 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:09.981 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:09.984 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:09.984 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:09.990 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:09.997 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.997 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:09.997 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:09.999 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:10.003 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.003 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.004 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x6128dd60, L:/127.0.0.1:60962 - R:/127.21.224.131:37413] using TOKEN/null
12:16:10.004 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:10.011 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3959ba32, L:/127.0.0.1:58352 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:10.012 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:10.015 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:10.016 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd8fe3d63, L:/127.0.0.1:50392 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:10.017 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:10.025 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:10.025 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:10.026 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.028 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x945ff651, L:/127.0.0.1:58356 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:10.029 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.031 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:10.034 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:10.038 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd6c00660, L:/127.0.0.1:39510 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:10.039 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:10.041 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:10.044 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:10.044 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=124), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [60ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.190:35543: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.188:40821: OK, [88ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:10.044 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:10.045 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:10.046 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:10.046 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.047 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.048 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:10.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.051 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@240c908e
12:16:10.052 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.224.188:40821(127.21.224.188:40821)] Successfully connected to peer
12:16:10.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:16:10.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.053 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:16:10.056 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:10.057 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.224.190:35543(127.21.224.190:35543)] Successfully connected to peer
12:16:10.058 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.061 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x58b6565a, L:/127.0.0.1:39512 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:10.062 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.224.189:39039(127.21.224.189:39039)] Successfully connected to peer
12:16:10.065 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:10.065 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=132), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [100ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:10.065 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:10.068 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.072 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.189
12:16:10.073 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdf7d6ec4, L:/127.0.0.1:50418 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:10.077 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.077 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2408f086
12:16:10.080 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:16:10.080 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:16:10.084 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:10.088 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.188
12:16:10.092 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.094 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:10.094 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:10.094 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:10.094 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.094 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.095 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.095 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.095 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.095 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.095 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.095 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.095 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.095 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:10.099 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2e275e92, L:/127.0.0.1:39518 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:10.099 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.101 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.101 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:10.101 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:10.101 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:10.101 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.101 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.101 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.102 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.102 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.102 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.102 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.102 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.102 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.102 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:10.104 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:10.104 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=145), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [96ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.188:40821: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:10.105 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:16:10.106 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bf0f083c37fd3f6df6c3659dfd153500c8c39a4f0b8cf89eee166a5a7df9b227'}]
12:16:10.107 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1e546db6, L:/127.0.0.1:50424 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:10.107 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.109 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa30655f2, L:/127.0.0.1:39522 - R:/127.21.224.189:39039] using SASL/PLAIN
12:16:10.112 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:10.112 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=155), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.188:40821, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.190:35543, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.224.189:39039, [78ms] Sub RPC ConnectToMaster: received response from server master-127.21.224.189:39039: OK, deferred=null) after lookup
12:16:10.118 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.119 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.123 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.123 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1104bcd9
12:16:10.124 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:16:10.124 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='4520f0d1830600eb8a007b93e6527f31876f0653d3977514df01ef82396d92f6'}]
12:16:10.126 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.127 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.130 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:10.131 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21939393
12:16:10.132 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:10.132 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:10.132 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:10.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.132 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.132 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.132 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.132 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.133 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.133 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.133 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.133 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:10.135 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:10.135 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:10.141 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:10.146 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.224.190
12:16:10.149 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x95dfa9cc, L:/127.0.0.1:50408 - R:/127.21.224.188:40821] using SASL/PLAIN
12:16:10.152 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.152 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:10.153 [DEBUG - main] (Connection.java:748) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] connecting to peer
12:16:10.153 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:10.154 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:10.154 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:10.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.154 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.154 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.154 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.154 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.154 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:10.158 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.162 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.163 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:16:10.166 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xad46d809, L:/127.0.0.1:58370 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:10.169 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xaeb1702c, L:/127.0.0.1:58380 - R:/127.21.224.190:35543] using SASL/PLAIN
12:16:10.179 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:16:10.187 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:16:10.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:16:10.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:16:10.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:16:10.188 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:16:10.189 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:16:10.190 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='02a6b4624a0871ec73c1dcc2e115a4d09519b66eebb2b352afb5943c73bf8065'}]
12:16:10.192 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.197 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.214 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] Successfully connected to peer
12:16:10.215 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:10.215 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:10.230 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:16:10.230 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='220bf2d36313b8c3edc8bae3f745aa4f96d647fb2012b85575fd0545b43af824'}]
12:16:10.231 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.232 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:16:10.236 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:10.237 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.237 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:10.242 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xf9f9c92e, L:/127.0.0.1:34884 - R:/127.21.224.130:37235] using TOKEN/null
12:16:10.242 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:10.243 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:10.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.255 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.256 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:10.259 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.261 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.261 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:10.262 [DEBUG - main] (Connection.java:748) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] connecting to peer
12:16:10.265 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.277 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.280 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.290 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.290 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.294 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:10.295 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:10.295 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:10.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.295 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.295 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.295 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.295 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.295 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.295 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.296 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.296 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:10.299 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.301 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] Successfully connected to peer
12:16:10.308 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeca9741c, L:/127.0.0.1:50814 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.312 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.319 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.329 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.341 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.344 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.347 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.351 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x219839fe, L:/127.0.0.1:50816 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.357 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x04042102, L:/127.0.0.1:55706 - R:/127.21.224.129:35357] using TOKEN/null
12:16:10.360 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.368 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=647c61a50b44498fa3eeefd2a9e9edf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.369 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [bf0f083c37fd3f6df6c3659dfd153500c8c39a4f0b8cf89eee166a5a7df9b227]
12:16:10.369 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:16:10.370 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.372 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bf0f083c37fd3f6df6c3659dfd153500c8c39a4f0b8cf89eee166a5a7df9b227]
12:16:10.375 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:10.375 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:10.376 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:10.376 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bf0f083c37fd3f6df6c3659dfd153500c8c39a4f0b8cf89eee166a5a7df9b227 finished by subtask 0; deferring removal (restored in pending)
12:16:10.376 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:10.378 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='220966b9ed9df983e223878139e59fffc24abbeddc3c5078ff1f6e9f8690ac97'}]
12:16:10.379 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.384 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.384 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.385 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.386 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.386 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.390 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.390 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:10.392 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf87ae940, L:/127.0.0.1:50818 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.397 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.397 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:16:10.401 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:10.402 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa03d04c9, L:/127.0.0.1:50830 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.413 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.413 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:10.419 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.419 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:10.420 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.421 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [02a6b4624a0871ec73c1dcc2e115a4d09519b66eebb2b352afb5943c73bf8065]
12:16:10.421 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:16:10.423 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [02a6b4624a0871ec73c1dcc2e115a4d09519b66eebb2b352afb5943c73bf8065]
12:16:10.424 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:10.424 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:10.428 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:10.429 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 02a6b4624a0871ec73c1dcc2e115a4d09519b66eebb2b352afb5943c73bf8065 finished by subtask 2; deferring removal (restored in pending)
12:16:10.430 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='f4fbe3a59f76b26ed1eea9992f12f1862d347c6e7a02fdeac8494237ab933f1e'}]
12:16:10.430 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:10.430 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.430 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.430 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.431 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.432 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:10.432 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:10.434 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.435 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [4520f0d1830600eb8a007b93e6527f31876f0653d3977514df01ef82396d92f6]
12:16:10.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [4520f0d1830600eb8a007b93e6527f31876f0653d3977514df01ef82396d92f6]
12:16:10.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:10.435 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:10.436 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 4520f0d1830600eb8a007b93e6527f31876f0653d3977514df01ef82396d92f6 finished by subtask 1; deferring removal (restored in pending)
12:16:10.436 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:10.437 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:10.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:10.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:10.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:10.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:10.458 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.458 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.458 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:10.458 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.458 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.458 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:10.458 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:10.461 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.462 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [220bf2d36313b8c3edc8bae3f745aa4f96d647fb2012b85575fd0545b43af824]
12:16:10.462 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:16:10.465 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [220bf2d36313b8c3edc8bae3f745aa4f96d647fb2012b85575fd0545b43af824]
12:16:10.466 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 220bf2d36313b8c3edc8bae3f745aa4f96d647fb2012b85575fd0545b43af824 finished by subtask 3; deferring removal (restored in pending)
12:16:10.469 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:10.469 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:10.469 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:10.470 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:10.476 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.476 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:10.481 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:10.481 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:10.481 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:10.482 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:10.482 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:10.482 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:10.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:10.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:10.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:10.485 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:10.485 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:10.485 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:10.485 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:10.486 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.486 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.486 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.486 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.487 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:10.487 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:10.488 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:10.488 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.488 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:10.489 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.495 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.495 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:10.497 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:10.497 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:10.498 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:10.498 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:10.501 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.501 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:10.502 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:10.502 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:10.502 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:10.502 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.502 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.502 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.502 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.503 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.503 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.503 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512970502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:10.503 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.503 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.503 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:10.505 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@4dc2a590, flushNotification=Deferred@836121592(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:10.505 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=3, operationSize=189, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@242d9c, flushNotification=Deferred@1068254545(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:10.505 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] connecting to peer
12:16:10.505 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] connecting to peer
12:16:10.508 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:10.508 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:10.509 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:10.509 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.509 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.509 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.509 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.509 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.509 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.510 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.510 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.510 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.510 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:10.512 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.513 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:10.513 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:10.513 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:10.513 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:10.513 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.513 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:10.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:10.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:10.514 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:10.519 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.519 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:10.525 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@51cb261c, flushNotification=Deferred@2125439927(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:10.526 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] connecting to peer
12:16:10.526 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:16:10.531 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:10.541 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] Successfully connected to peer
12:16:10.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.576 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.576 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:10.582 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.582 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:10.586 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:10.586 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:10.586 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:10.587 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:10.589 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.589 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:10.596 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.596 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:10.598 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.600 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8e2d77f4, L:/127.0.0.1:60970 - R:/127.21.224.131:37413] using TOKEN/null
12:16:10.603 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.604 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:10.609 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] Successfully connected to peer
12:16:10.612 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.612 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:10.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.621 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] Successfully connected to peer
12:16:10.643 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.644 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.647 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xfd76e98d, L:/127.0.0.1:55708 - R:/127.21.224.129:35357] using TOKEN/null
12:16:10.649 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x7a002687, L:/127.0.0.1:60976 - R:/127.21.224.131:37413] using TOKEN/null
12:16:10.652 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:10.652 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:10.652 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:10.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.654 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.654 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.654 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:10.666 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:10.666 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:10.666 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:10.667 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.667 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:10.667 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.667 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.667 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:10.668 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.668 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.668 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:10.668 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:10.686 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:10.687 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.705 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.709 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:10.710 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:10.710 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:10.710 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:10.713 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.717 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd6dd71e7, L:/127.0.0.1:50838 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.721 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:10.721 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:10.721 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:16:10.721 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:10.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.722 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:10.722 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:10.727 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:10.730 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.730 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [220966b9ed9df983e223878139e59fffc24abbeddc3c5078ff1f6e9f8690ac97]
12:16:10.733 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.733 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:10.737 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.738 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:10.743 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.743 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:10.748 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.748 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:10.751 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:10.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.758 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf11d3c3c, L:/127.0.0.1:50852 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:10.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.775 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false, responseScanTimestamp = 7305269124091904001) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.775 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [f4fbe3a59f76b26ed1eea9992f12f1862d347c6e7a02fdeac8494237ab933f1e]
12:16:10.794 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:10.795 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:10.795 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:10.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:10.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:10.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:10.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:10.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:10.796 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:10.796 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:10.796 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:10.796 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:10.796 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:10.812 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.812 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:10.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:10.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:10.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:10.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:10.863 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.863 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.863 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:10.863 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.863 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.863 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:10.863 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.863 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.864 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:10.864 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:10.885 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.885 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:10.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:10.872357 23222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.224.130:37235, user_credentials={real_user=slave}} blocked reactor thread for 44913.5us
12:16:10.902 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.902 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:10.911 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:10.911 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:10.911 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:10.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.912 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.912 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.912 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.912 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.912 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:10.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:10.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:10.917 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:10.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:10.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:10.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:10.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:10.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:10.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:10.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:10.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:10.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:10.918 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:10.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [f4fbe3a59f76b26ed1eea9992f12f1862d347c6e7a02fdeac8494237ab933f1e]
12:16:10.987 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:16:10.987 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:16:10.987 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:10.988 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:10.989 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:10.989 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:10.989 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:10.989 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.990 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.990 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:10.989 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split f4fbe3a59f76b26ed1eea9992f12f1862d347c6e7a02fdeac8494237ab933f1e finished by subtask 2; deferring removal (restored in pending)
12:16:10.990 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.990 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.990 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:10.990 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.990 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.990 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:10.990 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:10.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:10.998 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.005 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [220966b9ed9df983e223878139e59fffc24abbeddc3c5078ff1f6e9f8690ac97]
12:16:11.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:16:11.006 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:16:11.006 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:11.006 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 220966b9ed9df983e223878139e59fffc24abbeddc3c5078ff1f6e9f8690ac97 finished by subtask 0; deferring removal (restored in pending)
12:16:11.007 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:11.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:11.042128 23797 log.cc:927] Time spent T 69aed12c303849ad88879ee51f1e65d5 P 47c08d351c2d48108b4850a050167e82: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
12:16:11.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.057 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.057 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.058 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job 1ca37d58d1e10dcfad9f21d692b10dbc (5044 bytes, checkpointDuration=555 ms, finalizationTime=1 ms).
12:16:11.059 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:16:11.059 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split f4fbe3a59f76b26ed1eea9992f12f1862d347c6e7a02fdeac8494237ab933f1e from pending
12:16:11.059 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 02a6b4624a0871ec73c1dcc2e115a4d09519b66eebb2b352afb5943c73bf8065 from pending
12:16:11.060 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 4520f0d1830600eb8a007b93e6527f31876f0653d3977514df01ef82396d92f6 from pending
12:16:11.060 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 220966b9ed9df983e223878139e59fffc24abbeddc3c5078ff1f6e9f8690ac97 from pending
12:16:11.060 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 220bf2d36313b8c3edc8bae3f745aa4f96d647fb2012b85575fd0545b43af824 from pending
12:16:11.060 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split bf0f083c37fd3f6df6c3659dfd153500c8c39a4f0b8cf89eee166a5a7df9b227 from pending
12:16:11.060 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 6 finished splits from enumerator state
12:16:11.061 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512971060 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:11.062 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=2, operationSize=126, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@348c2cc3, flushNotification=Deferred@1582945812(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:11.063 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] connecting to peer
12:16:11.064 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=1, operationSize=63, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@6acea253, flushNotification=Deferred@445598672(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:11.065 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] connecting to peer
12:16:11.069 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.069 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.076 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.076 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.083 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:11.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:11.083 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:11.084 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:16:11.103 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:11.103 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:11.104 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:16:11.104 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:16:11.107 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] Successfully connected to peer
12:16:11.113 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] Successfully connected to peer
12:16:11.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.140 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.140 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.146 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.146 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.156 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.156 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.165 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.165 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.171 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.172 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.172 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.172 [DEBUG - kudu-nio-4] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.178 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.178 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.185 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x5a099d14, L:/127.0.0.1:55714 - R:/127.21.224.129:35357] using TOKEN/null
12:16:11.194 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xddf20185, L:/127.0.0.1:34888 - R:/127.21.224.130:37235] using TOKEN/null
12:16:11.234 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:11.234 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:11.234 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:11.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.235 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.235 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.235 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.236 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.237 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.237 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.237 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:11.241 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.241 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.247 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.248 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.258 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.259 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.271 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.271 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.277 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.287 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.287 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.307 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.308 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.315 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:11.315 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:11.315 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:11.316 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.316 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.316 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.316 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.316 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.316 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.317 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.317 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.317 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.317 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:11.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.323 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=263 ms, finalizationTime=0 ms).
12:16:11.326 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:16:11.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.389 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.389 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.398 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.398 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.406 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.406 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.420 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.428 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.428 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.432 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:11.436 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:11.440 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:11.443 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:11.449 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:11.449 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:11.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:11.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:11.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:11.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:11.450 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:11.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:11.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:11.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:11.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:11.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:11.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:11.463 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:11.468 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:11.472 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 251f93a4acb14229b56bc5e591ca5eab
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:11.477 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:11.477 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:11.478 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.36.190:33455, [5ms] Sub RPC GetTableLocations: received response from server master-127.21.36.190:33455: OK, deferred=null)) after lookup
12:16:11.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512971502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:11.513 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:16:11.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:16:11.521 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=647c61a50b44498fa3eeefd2a9e9edf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.521 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 647c61a50b44498fa3eeefd2a9e9edf1 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.528 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.528 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.537 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.537 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 813326281f7b43a6aed811d25f91295c for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.545 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.545 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 071109eb1eb6484b816f6e592158c4db for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.562 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.563 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 16afc913be4442278554da31226401e4 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.587 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.588 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6a07f1f4846c4dc89d48f0eb12f82116 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 69aed12c303849ad88879ee51f1e65d5 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 28ba685ff6104af184a6435f42a45254 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b7ddb05d5d1045b5908e623a2aa560cf for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 16a96b2aa0de460b91f73b91837cd938 for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 50f99869ee7148fdbe17c4cdb611c839 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet bd95f899c3fc422bb6d028773bf76481 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:11.593 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=69aed12c303849ad88879ee51f1e65d5@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=28ba685ff6104af184a6435f42a45254@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=b7ddb05d5d1045b5908e623a2aa560cf@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)[L],47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=16a96b2aa0de460b91f73b91837cd938@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=50f99869ee7148fdbe17c4cdb611c839@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235),2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)[L]]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=bd95f899c3fc422bb6d028773bf76481@[035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)[L],2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413),47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:11.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.224.189:39039, [5ms] Sub RPC GetTableLocations: received response from server master-127.21.224.189:39039: OK, deferred=null)) after lookup
12:16:11.608 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.609 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:11.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:11.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:11.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.615 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.615 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.615 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.615 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:11.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.633 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.633 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.643 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.643 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.646 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:11.646 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:11.646 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:11.646 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:11.646 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:11.646 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:11.647 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:11.647 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:11.647 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:11.647 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:11.647 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:11.647 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:11.647 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:11.661 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.661 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.722 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.723 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.743 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=647c61a50b44498fa3eeefd2a9e9edf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.743 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 647c61a50b44498fa3eeefd2a9e9edf1 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.754 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:11.758 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.758 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:11.761 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:11.762 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:11.767 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='af39c01b238052e867f225ef344397c9f1a67d2bfd68ca71f6e58127c9e18fe2'}]
12:16:11.768 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:11.769 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='d4154d7bd6f866dad4e6fa379a417cad9016a7b2344701b012231cde9c54baa0'}]
12:16:11.770 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:11.770 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='5824a198920462ad22b771e92f482d5d554d9f7eddce20f1b2f44aa1a47ece08'}]
12:16:11.771 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:11.771 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9a2759c2e747929d70c07d6de965256ab7644a9cfdecf5f0af3130e37cb0017f'}]
12:16:11.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.773 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:11.773 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:11.773 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:11.774 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:16:11.774 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.774 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.774 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.774 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.774 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.774 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.774 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:11.775 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.775 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.775 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.775 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:11.775 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 1
12:16:11.775 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:11.775 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:16:11.776 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:11.777 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:11.777 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:16:11.778 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299997, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:11.793 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:11.799 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.799 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 813326281f7b43a6aed811d25f91295c for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.815 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.816 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 071109eb1eb6484b816f6e592158c4db for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:11.816359 22388 debug-util.cc:398] Leaking SignalData structure 0x7b080003c1e0 after lost signal to thread 22251
12:16:11.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:11.817663 22388 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4f60 after lost signal to thread 22391
12:16:11.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:11.825 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:11.834 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:11.845 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:11.854 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:11.867 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.867 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 16afc913be4442278554da31226401e4 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.869 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:11.880 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.881 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 6a07f1f4846c4dc89d48f0eb12f82116 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.881 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:11.885 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:11.890 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:11.893 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:11.893 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:11.893 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:11.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:11.894 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.894 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.894 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:11.894 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.894 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.895 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:11.895 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:11.906 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:11.916 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.922 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=69aed12c303849ad88879ee51f1e65d5, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.923 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet 69aed12c303849ad88879ee51f1e65d5 for partition [0x0000000000000000, 0x0000000000000001) with scanner id null
12:16:11.928 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:11.929 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9d785af9, L:/127.0.0.1:50858 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:11.931 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=28ba685ff6104af184a6435f42a45254, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.931 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet 28ba685ff6104af184a6435f42a45254 for partition [0x0000000000000001, 0x0000000000000002) with scanner id null
12:16:11.938 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:11.943 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.947 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=b7ddb05d5d1045b5908e623a2aa560cf, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.948 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:822) Done scanning tablet b7ddb05d5d1045b5908e623a2aa560cf for partition [0x0000000100000000, 0x0000000100000001) with scanner id null
12:16:11.958 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=16a96b2aa0de460b91f73b91837cd938, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.958 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 16a96b2aa0de460b91f73b91837cd938 for partition [0x0000000100000001, 0x0000000100000002) with scanner id null
12:16:11.970 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 2 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=50f99869ee7148fdbe17c4cdb611c839, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.970 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:822) Done scanning tablet 50f99869ee7148fdbe17c4cdb611c839 for partition [0x0000000200000000, 0x0000000200000001) with scanner id null
12:16:11.981 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.981 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbfc3e68f, L:/127.0.0.1:50864 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:11.984 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:11.990 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x30c02c14, L:/127.0.0.1:50854 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:11.994 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 1 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=bd95f899c3fc422bb6d028773bf76481, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:11.995 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:822) Done scanning tablet bd95f899c3fc422bb6d028773bf76481 for partition [0x0000000200000001, 0x0000000200000002) with scanner id null
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.190:35543(127.21.224.190:35543)] disconnecting while in state READY
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] disconnecting while in state READY
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.188:40821(127.21.224.188:40821)] disconnecting while in state READY
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] disconnecting while in state READY
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer master-127.21.224.189:39039(127.21.224.189:39039)] disconnecting while in state READY
12:16:11.996 [DEBUG - main] (Connection.java:575) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] disconnecting while in state READY
12:16:11.996 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:11.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:11.996 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:11.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:11.997 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:11.997 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:11.997 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] handling channelInactive
12:16:11.997 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] cleaning up while in state READY due to: connection closed
12:16:11.998 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] handling channelInactive
12:16:11.998 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] cleaning up while in state READY due to: connection closed
12:16:11.998 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:11.999 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-3
12:16:11.999 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:16:11.999 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-5
12:16:11.999 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
12:16:11.999 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:12.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512972002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:12.004 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.004 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [d4154d7bd6f866dad4e6fa379a417cad9016a7b2344701b012231cde9c54baa0]
12:16:12.004 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [d4154d7bd6f866dad4e6fa379a417cad9016a7b2344701b012231cde9c54baa0]
12:16:12.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:16:12.005 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:16:12.005 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.005 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split d4154d7bd6f866dad4e6fa379a417cad9016a7b2344701b012231cde9c54baa0 finished by subtask 3; deferring removal (restored in pending)
12:16:12.005 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.009 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:12.010 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:12.010 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:12.012 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.012 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.012 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.012 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.012 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.012 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.012 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.012 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.012 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.013 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:12.013 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xeb1603f9, L:/127.0.0.1:50876 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:12.019 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] handling channelInactive
12:16:12.019 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] cleaning up while in state READY due to: connection closed
12:16:12.019 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-4
12:16:12.021 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bc398c37338f13398c4cf253bf4e6ca7a76b8dbc5003c85358651ced6a8e452b'}]
12:16:12.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.020560 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22751
12:16:12.023 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:12.024 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job 1ca37d58d1e10dcfad9f21d692b10dbc (5104 bytes, checkpointDuration=22 ms, finalizationTime=0 ms).
12:16:12.029 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:16:12.029 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split d4154d7bd6f866dad4e6fa379a417cad9016a7b2344701b012231cde9c54baa0 from pending
12:16:12.029 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
12:16:12.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.054 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.054 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [9a2759c2e747929d70c07d6de965256ab7644a9cfdecf5f0af3130e37cb0017f]
12:16:12.055 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9a2759c2e747929d70c07d6de965256ab7644a9cfdecf5f0af3130e37cb0017f]
12:16:12.055 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:16:12.055 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:16:12.056 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9a2759c2e747929d70c07d6de965256ab7644a9cfdecf5f0af3130e37cb0017f finished by subtask 0; deferring removal (restored in pending)
12:16:12.058 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.059 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='bb9eadc92666483b11a8d054688247443584e96d311d2699d52eeab9a755c40a'}]
12:16:12.061 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:12.062 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:16:12.062 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:12.063 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.073 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.074 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [5824a198920462ad22b771e92f482d5d554d9f7eddce20f1b2f44aa1a47ece08]
12:16:12.074 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [5824a198920462ad22b771e92f482d5d554d9f7eddce20f1b2f44aa1a47ece08]
12:16:12.074 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:16:12.074 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:16:12.075 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.075 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 5824a198920462ad22b771e92f482d5d554d9f7eddce20f1b2f44aa1a47ece08 finished by subtask 2; deferring removal (restored in pending)
12:16:12.076 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.097 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:12.097 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:12.097 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:12.098 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:12.098 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:12.098 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:12.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:12.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:12.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:12.098 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:12.098 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:12.098 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:12.098 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:12.100 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:16:12.100 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.101 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.130 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.130 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.130 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:16:12.135 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:12.153 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.153 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.153 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.154 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:16:12.161 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:12.165 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:12.175 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:16:12.176 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299997, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:12.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:12.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:12.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:12.182 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.182 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.182 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.182 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.182 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.182 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.182 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.182 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.182 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:12.188 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=647c61a50b44498fa3eeefd2a9e9edf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.188 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [af39c01b238052e867f225ef344397c9f1a67d2bfd68ca71f6e58127c9e18fe2]
12:16:12.188 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [af39c01b238052e867f225ef344397c9f1a67d2bfd68ca71f6e58127c9e18fe2]
12:16:12.189 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 1 because it is idle.
12:16:12.189 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 1
12:16:12.189 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split af39c01b238052e867f225ef344397c9f1a67d2bfd68ca71f6e58127c9e18fe2 finished by subtask 1; deferring removal (restored in pending)
12:16:12.189 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.190 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.194 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:12.200 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:12.213 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x02698ac6, L:/127.0.0.1:50892 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:12.227 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.228 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [bb9eadc92666483b11a8d054688247443584e96d311d2699d52eeab9a755c40a]
12:16:12.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bb9eadc92666483b11a8d054688247443584e96d311d2699d52eeab9a755c40a]
12:16:12.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:16:12.228 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:16:12.229 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bb9eadc92666483b11a8d054688247443584e96d311d2699d52eeab9a755c40a finished by subtask 0; deferring removal (restored in pending)
12:16:12.229 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.230 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:12.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:12.234 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:12.234 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.234 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.234 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.234 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.234 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.235 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.235 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.235 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.235 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.235 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:12.235 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:12.235 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:12.235 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:12.235 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.235 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.236 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.236 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.236 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.236 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.236 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.236 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.236 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:12.227 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:12.247 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] handling channelInactive
12:16:12.247 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] cleaning up while in state READY due to: connection closed
12:16:12.247 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] handling channelInactive
12:16:12.247 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] cleaning up while in state READY due to: connection closed
12:16:12.247 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:12.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.249722 23223 connection.cc:573] client connection to 127.21.224.129:35357 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:16:12.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.250164 23223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:16:12.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.269332 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22916
12:16:12.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.276 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:12.288 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4559dba4, L:/127.0.0.1:50896 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:12.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.298463 23223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.21.224.129:35357, user_credentials={real_user=slave}} blocked reactor thread for 48346.7us
12:16:12.303 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269132283904001) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:12.303 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [bc398c37338f13398c4cf253bf4e6ca7a76b8dbc5003c85358651ced6a8e452b]
12:16:12.303 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [bc398c37338f13398c4cf253bf4e6ca7a76b8dbc5003c85358651ced6a8e452b]
12:16:12.304 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:16:12.304 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:16:12.304 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.304 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:16:12.305 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.305 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split bc398c37338f13398c4cf253bf4e6ca7a76b8dbc5003c85358651ced6a8e452b finished by subtask 3; deferring removal (restored in pending)
12:16:12.305 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:12.306 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:12.307 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.307 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.307 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.307 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 1 exited.
12:16:12.316 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:12.316 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:12.316 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:12.316 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:16:12.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.325695 23223 consensus_peers.cc:597] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 -> Peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Couldn't send request to peer 47c08d351c2d48108b4850a050167e82. Status: Network error: Client connection negotiation failed: client connection to 127.21.224.129:35357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:16:12.329 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:12.330 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:12.330 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:12.330 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.330 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.330 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.331 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.404345 23223 consensus_peers.cc:597] T b7ddb05d5d1045b5908e623a2aa560cf P 2b5802e7d4c448dfb93dd1bfb573d384 -> Peer 47c08d351c2d48108b4850a050167e82 (127.21.224.129:35357): Couldn't send request to peer 47c08d351c2d48108b4850a050167e82. Status: Network error: Client connection negotiation failed: client connection to 127.21.224.129:35357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:16:12.417 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] handling channelInactive
12:16:12.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 035e9dc71535495dad5692c3f75985a8(127.21.224.130:37235)] cleaning up while in state READY due to: connection closed
12:16:12.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:12.430589 23222 consensus_peers.cc:597] T 69aed12c303849ad88879ee51f1e65d5 P 2b5802e7d4c448dfb93dd1bfb573d384 -> Peer 035e9dc71535495dad5692c3f75985a8 (127.21.224.130:37235): Couldn't send request to peer 035e9dc71535495dad5692c3f75985a8. Status: Network error: Client connection negotiation failed: client connection to 127.21.224.130:37235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:16:12.437 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:12.438 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:12.438 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:12.438 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:12.438 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:12.438 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:12.439 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:12.439 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:12.439 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:12.439 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:12.439 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:12.439 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:12.439 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.440868 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 23150
12:16:12.490 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:12.490 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:12.490 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:12.491 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.491 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:12.491 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.491 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.491 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:12.491 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.491 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.491 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:12.491 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:12.499 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] handling channelInactive
12:16:12.499 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] cleaning up while in state READY due to: connection closed
12:16:12.500 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] handling channelInactive
12:16:12.500 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] cleaning up while in state READY due to: connection closed
12:16:12.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.501483 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22414
12:16:12.513 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512972504 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:12.521 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job 1ca37d58d1e10dcfad9f21d692b10dbc (4414 bytes, checkpointDuration=17 ms, finalizationTime=0 ms).
12:16:12.523 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:16:12.523 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split bb9eadc92666483b11a8d054688247443584e96d311d2699d52eeab9a755c40a from pending
12:16:12.523 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split bc398c37338f13398c4cf253bf4e6ca7a76b8dbc5003c85358651ced6a8e452b from pending
12:16:12.524 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 9a2759c2e747929d70c07d6de965256ab7644a9cfdecf5f0af3130e37cb0017f from pending
12:16:12.524 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split 5824a198920462ad22b771e92f482d5d554d9f7eddce20f1b2f44aa1a47ece08 from pending
12:16:12.524 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 5 complete: removed split af39c01b238052e867f225ef344397c9f1a67d2bfd68ca71f6e58127c9e18fe2 from pending
12:16:12.524 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 5 complete: removed 5 finished splits from enumerator state
12:16:12.543 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:12.543 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:12.543 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:12.544 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.544 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.544 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.544 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.546 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.546 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.546 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.546 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:12.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.561 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:12.561 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:12.561 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:12.562 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:12.562 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:12.561 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.224.190:35543(127.21.224.190:35543)] handling channelInactive
12:16:12.562 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:12.562 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state READY due to: connection closed
12:16:12.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.576961 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22547
12:16:12.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.621 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:12.622 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:12.622 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:12.622 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:12.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:12.622 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:12.622 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:12.623 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:12.623 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:12.623 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:12.623 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:12.623 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:12.623 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:12.638 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:12.638 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:12.639 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:12.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:12.639 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:12.639 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:12.640 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.224.189:39039(127.21.224.189:39039)] handling channelInactive
12:16:12.640 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state READY due to: connection closed
12:16:12.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:12.650408 22402 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22623
12:16:12.669 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:12.670 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:12.670 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:12.670 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:12.670 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:12.671 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:12.671 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:12.671 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:12.671 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:12.671 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:12.671 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:12.671 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:12.671 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:12.698 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:12.698 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:12.698 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:12.700 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:12.701 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:12.701 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:12.701 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.224.188:40821(127.21.224.188:40821)] handling channelInactive
12:16:12.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state READY due to: connection closed
12:16:12.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.794 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:12.795 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:12.795 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:12.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:12.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:12.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:12.795 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:12.820 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:12.829 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:12.829 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:12.829 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:12.830 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.830 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.830 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:12.830 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.830 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.830 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:12.830 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.830 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.830 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:12.830 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:12.874 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:12.874 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:12.874 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:12.875 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.875 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.875 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:12.876 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.876 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.876 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:12.876 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.876 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.876 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:12.876 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:13.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512973002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:13.014 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:13.023 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:16:13.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.074 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:13.075 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:13.075 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:13.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:13.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:13.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:13.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:13.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:13.076 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:13.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:13.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:13.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:13.076 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:13.122 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:13.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:13.181 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:13.182 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.182 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.182 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.182 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.182 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.183 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.183 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.183 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.183 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:13.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:13.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:13.210 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:13.211 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.211 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.211 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.211 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.211 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.211 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.211 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.211 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.211 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.211 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:13.242 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:13.242 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:13.242 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:13.242 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:13.242 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:13.242 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:13.243 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:13.243 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:13.243 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:13.243 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:13.243 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:13.243 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:13.243 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:13.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.273 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.357 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:13.357 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:13.357 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:13.358 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.358 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.358 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.358 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.358 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.358 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.358 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.358 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.358 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.358 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:13.504 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512973503 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:13.519 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:16:13.520 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:16:13.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.634 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:13.634 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:13.634 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:13.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:13.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.635 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:13.636 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.636 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.636 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:13.636 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:13.737 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:13.738 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:13.738 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:13.738 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:13.738 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:13.738 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:13.738 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:13.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:13.738 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:13.739 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:13.739 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:13.739 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:13.739 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:13.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.758 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:13.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:13.764 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:13.768 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='486c40f0b77aebc2e4d048a83dfa5ea38ab9e26f9337cb00ae8c97767be08c1d'}]
12:16:13.770 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.770 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6638bf5220bf7e90595cc294c31b03b7612a37a3e7711f2a66b1327cf14423cc'}]
12:16:13.772 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.772 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='e548a8809f0fbcb6345272aab32454045ecbb8ab5d071014dc5eeb052f335f09'}]
12:16:13.773 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.773 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='6b2bbc50045fc4b74fa3a4eba1c6d603cfb1a278d2cc65d41fd635bc971c01f7'}]
12:16:13.773 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.774 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.775 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:16:13.775 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:13.776 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 2
12:16:13.776 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:13.777 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:16:13.777 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:16:13.777 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:13.777 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:13.784 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.789 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.795 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.801 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.813 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:13.813 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:13.813 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:13.814 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.814 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.814 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:13.814 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.814 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.814 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:13.815 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.815 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.815 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:13.815 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:13.817 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:13.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:13.826 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:13.829 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:13.835 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:13.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:13.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:13.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:13.843 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:13.843 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:13.843 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:13.843 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:13.843 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x722af28c, L:/127.0.0.1:50906 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:13.843 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:13.843 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:13.843 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:13.843 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:13.844 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:13.844 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:13.851 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:13.852 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:13.853 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:13.854 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:13.854 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:13.854 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:13.855 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:13.855 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:13.855 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:13.855 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:13.855 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:13.855 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:13.855 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:13.855 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:13.855 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:13.855 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:13.858 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:13.861 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:13.867 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x32ef9529, L:/127.0.0.1:50920 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:13.878 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:13.878 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:13.879 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [6638bf5220bf7e90595cc294c31b03b7612a37a3e7711f2a66b1327cf14423cc]
12:16:13.879 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6638bf5220bf7e90595cc294c31b03b7612a37a3e7711f2a66b1327cf14423cc]
12:16:13.879 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 2 because it is idle.
12:16:13.879 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 2
12:16:13.880 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6638bf5220bf7e90595cc294c31b03b7612a37a3e7711f2a66b1327cf14423cc finished by subtask 1; deferring removal (restored in pending)
12:16:13.882 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:13.883 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='616ed3b966a639748921f6fd04827cfca86a0d0d80c82b4337a6ac0631eeaa61'}]
12:16:13.884 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.885 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 3
12:16:13.885 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:13.885 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:13.895 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:13.899 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:13.900 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xf549d7c9, L:/127.0.0.1:50930 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:13.902 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xa12f33c8, L:/127.0.0.1:50938 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:13.916 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:13.916 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [6b2bbc50045fc4b74fa3a4eba1c6d603cfb1a278d2cc65d41fd635bc971c01f7]
12:16:13.916 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [6b2bbc50045fc4b74fa3a4eba1c6d603cfb1a278d2cc65d41fd635bc971c01f7]
12:16:13.917 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:16:13.917 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:16:13.918 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 6b2bbc50045fc4b74fa3a4eba1c6d603cfb1a278d2cc65d41fd635bc971c01f7 finished by subtask 3; deferring removal (restored in pending)
12:16:13.919 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:13.919 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='a8618c32bd9ec2ee907e62472bd15ebf1eed866122f11cbb542466cebcc533a5'}]
12:16:13.921 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:13.921 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:16:13.922 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.922 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299998, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:13.923 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:13.931 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:13.931 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [e548a8809f0fbcb6345272aab32454045ecbb8ab5d071014dc5eeb052f335f09]
12:16:13.931 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [e548a8809f0fbcb6345272aab32454045ecbb8ab5d071014dc5eeb052f335f09]
12:16:13.932 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:16:13.932 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:16:13.932 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:13.933 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split e548a8809f0fbcb6345272aab32454045ecbb8ab5d071014dc5eeb052f335f09 finished by subtask 0; deferring removal (restored in pending)
12:16:13.938 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:13.944 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:13.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:13.944 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:16:13.944 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 2 exited.
12:16:13.972 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:13.991 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:13.992 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:13.992 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:13.992 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:13.992 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:13.992 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:13.992 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:13.992 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:13.993 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:13.993 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:13.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:13.993 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:13.993 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:13.993 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:13.998 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:14.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512974002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:14.012 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:14.014 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job 1ca37d58d1e10dcfad9f21d692b10dbc (5104 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:16:14.015 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:14.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:14.015 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:14.015 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:16:14.015 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:16:14.015 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 6b2bbc50045fc4b74fa3a4eba1c6d603cfb1a278d2cc65d41fd635bc971c01f7 from pending
12:16:14.015 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split 6638bf5220bf7e90595cc294c31b03b7612a37a3e7711f2a66b1327cf14423cc from pending
12:16:14.016 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 8 complete: removed split e548a8809f0fbcb6345272aab32454045ecbb8ab5d071014dc5eeb052f335f09 from pending
12:16:14.016 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 8 complete: removed 3 finished splits from enumerator state
12:16:14.032 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:14.032 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:14.032 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:14.033 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:16:14.037 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:14.040 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:14.046 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7c921cd8, L:/127.0.0.1:50950 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:14.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.061 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:14.061 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [616ed3b966a639748921f6fd04827cfca86a0d0d80c82b4337a6ac0631eeaa61]
12:16:14.062 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [616ed3b966a639748921f6fd04827cfca86a0d0d80c82b4337a6ac0631eeaa61]
12:16:14.062 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:16:14.062 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:16:14.063 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 616ed3b966a639748921f6fd04827cfca86a0d0d80c82b4337a6ac0631eeaa61 finished by subtask 1; deferring removal (restored in pending)
12:16:14.063 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:14.064 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:14.069 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:14.076 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9af3a2dc, L:/127.0.0.1:50962 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:14.098 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:16:14.098 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:14.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:14.098 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:14.109 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:14.110 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [a8618c32bd9ec2ee907e62472bd15ebf1eed866122f11cbb542466cebcc533a5]
12:16:14.110 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [a8618c32bd9ec2ee907e62472bd15ebf1eed866122f11cbb542466cebcc533a5]
12:16:14.110 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:16:14.110 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:16:14.111 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split a8618c32bd9ec2ee907e62472bd15ebf1eed866122f11cbb542466cebcc533a5 finished by subtask 3; deferring removal (restored in pending)
12:16:14.111 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:14.112 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:14.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.135 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269140475904001) for scanner KuduScanner(table=replication_test_table, tablet=647c61a50b44498fa3eeefd2a9e9edf1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:14.136 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [486c40f0b77aebc2e4d048a83dfa5ea38ab9e26f9337cb00ae8c97767be08c1d]
12:16:14.136 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [486c40f0b77aebc2e4d048a83dfa5ea38ab9e26f9337cb00ae8c97767be08c1d]
12:16:14.136 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 3 because it is idle.
12:16:14.136 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 3
12:16:14.138 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 486c40f0b77aebc2e4d048a83dfa5ea38ab9e26f9337cb00ae8c97767be08c1d finished by subtask 2; deferring removal (restored in pending)
12:16:14.138 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:14.139 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:14.147 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:14.147 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:14.147 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:14.148 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:16:14.164 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:14.164 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:14.164 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:14.165 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 3 exited.
12:16:14.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.274 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.336 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:14.336 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:14.336 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:14.336 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.336 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.336 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.336 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.336 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.337 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.336 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.337 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.337 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.337 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:14.397 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:14.397 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:14.397 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:14.398 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:14.398 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:14.398 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:14.398 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:14.398 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:14.398 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:14.398 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:14.398 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:14.398 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:14.398 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:14.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512974502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:14.512 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job 1ca37d58d1e10dcfad9f21d692b10dbc (3034 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:16:14.517 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:16:14.517 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 486c40f0b77aebc2e4d048a83dfa5ea38ab9e26f9337cb00ae8c97767be08c1d from pending
12:16:14.518 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split a8618c32bd9ec2ee907e62472bd15ebf1eed866122f11cbb542466cebcc533a5 from pending
12:16:14.518 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 9 complete: removed split 616ed3b966a639748921f6fd04827cfca86a0d0d80c82b4337a6ac0631eeaa61 from pending
12:16:14.518 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 9 complete: removed 3 finished splits from enumerator state
12:16:14.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.572 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:14.573 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:14.573 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:14.573 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:14.573 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:14.573 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:14.574 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:14.574 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:14.574 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:14.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:14.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:14.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:14.574 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:14.626 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.726 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:14.726 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:14.726 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:14.727 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.727 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.727 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.727 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.727 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.727 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.727 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.727 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.727 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.727 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:14.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.766 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:14.766 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:14.766 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:14.767 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.767 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.767 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:14.767 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.767 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.767 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:14.767 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.767 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.767 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:14.767 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:14.774 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:14.860 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:14.861 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:14.861 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:14.861 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:14.861 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:14.861 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:14.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:14.861 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:14.862 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:14.861 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:14.862 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:14.862 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:14.862 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:14.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:14Z chronyd exiting
12:16:14.974 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:14.974 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:14.974 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:14.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:14.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:14.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:14.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:14.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:14.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:14.975 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:14.975 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:14.975 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:14.975 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:15.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512975002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:15.022 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:16:15.025 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:16:15.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.093 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:15.093 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:15.093 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:15.094 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.094 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.094 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.095 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:15.104 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:15.104 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:15.104 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:15.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.105 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.105 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.105 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.105 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:15.120 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:15.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:15.149 [DEBUG - pool-340-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:15.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:15.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:15.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:15.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:15.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:15.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:15.150 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:15.150 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:15.150 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:15.150 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:15.151 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27431), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [8ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [25ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [99ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [99ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [182ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [241ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [542ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [542ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [621ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1081ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [5280ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5281ms] too many traces: truncated at 100 traces, deferred=Deferred@1017459776(state=PENDING, result=null, callback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685), errback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685)))
12:16:15.152 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:15.153 [WARN - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27431), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [8ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [25ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [99ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [99ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [182ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [241ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [542ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [542ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [621ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1081ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [5280ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5281ms] too many traces: truncated at 100 traces, deferred=Deferred@1017459776(state=PENDING, result=null, callback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685), errback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:15.153 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:16:15.155 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:16:15.157 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27431), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [8ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [9ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [25ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [63ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [99ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [99ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [181ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [182ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [182ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [241ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [242ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [242ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [301ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [302ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [302ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [540ms] refreshing cache from master, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [540ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [541ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [542ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [542ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [621ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [621ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1081ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2120ms] refreshing cache from master, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [5280ms] refreshing cache from master, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5281ms] too many traces: truncated at 100 traces, deferred=Deferred@1017459776(state=PENDING, result=null, callback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685), errback=(continuation of Deferred@679984890 after retry RPC after error@11147185) -> (continuation of Deferred@541571572 after retry RPC after error@894799496) -> (continuation of Deferred@540055222 after retry RPC after error@1886853790) -> (continuation of Deferred@1843561853 after retry RPC after error@1952081799) -> (continuation of Deferred@1350294172 after retry RPC after error@403741159) -> (continuation of Deferred@1637887733 after retry RPC after error@1189153561) -> (continuation of Deferred@1220576867 after retry RPC after error@1409544509) -> (continuation of Deferred@875866830 after retry RPC after error@2051262098) -> (continuation of Deferred@922526759 after retry RPC after error@2101162460) -> (continuation of Deferred@1817085551 after retry RPC after error@140356130) -> (continuation of Deferred@1532226194 after retry RPC after error@1333040117) -> (continuation of Deferred@1460738442 after retry RPC after error@855156208) -> (continuation of Deferred@1992019527 after retry RPC after error@498794590) -> (continuation of Deferred@1119459114 after retry RPC after error@890863016) -> (continuation of Deferred@502813882 after retry RPC after error@1485049515) -> (continuation of Deferred@1451934294 after retry RPC after error@671088914) -> (continuation of Deferred@1996676396 after retry RPC after error@260797489) -> (continuation of Deferred@252944356 after retry RPC after error@657655685) -> (continuation of Deferred@1186551282 after retry RPC after error@315067368) -> (continuation of Deferred@28891883 after retry RPC after error@1040771702) -> (continuation of Deferred@848445056 after retry RPC after error@472153073) -> (continuation of Deferred@1527547164 after retry RPC after error@573480785) -> (continuation of Deferred@23843754 after retry RPC after error@1043319685)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:15.158 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:15.159 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
12:16:15.160 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:16:15.160 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:16:15.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.501 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:15.502 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:15.502 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:15.502 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:15.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:15.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:15.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:15.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:15.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:15.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:15.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:15.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:15.503 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:15.504 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512975503 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:15.515 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:15.516 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:15.516 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:15.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.517 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.517 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.517 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.517 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:15.526 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job 1ca37d58d1e10dcfad9f21d692b10dbc (964 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
12:16:15.531 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:16:15.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.552 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:15.552 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:15.553 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:15.553 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:15.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:15.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:15.555 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:15.613 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:15.613 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:15.614 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:15.614 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.614 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.614 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.614 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.614 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.614 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.614 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.614 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.614 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.614 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:15.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.634 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:15.634 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:15.634 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:15.634 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.634 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.634 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.634 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.634 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.634 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.635 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.635 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.635 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.635 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:15.650 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:15.650 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:15.650 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:15.651 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.651 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.651 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.651 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.651 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:15.651 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.651 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.651 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:15.651 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:15.651 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:15.753 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8cbe72cac826486282e905791861128e
12:16:15.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.759 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 647c61a50b44498fa3eeefd2a9e9edf1 for table 'replication_test_table' with partition [0x0000000000000000, 0x0000000000000001)
12:16:15.759 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d3abe64b8dda4db0a7f9bf9b64d3c931 for table 'replication_test_table' with partition [0x0000000000000001, 0x0000000000000002)
12:16:15.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 813326281f7b43a6aed811d25f91295c for table 'replication_test_table' with partition [0x0000000100000000, 0x0000000100000001)
12:16:15.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 071109eb1eb6484b816f6e592158c4db for table 'replication_test_table' with partition [0x0000000100000001, 0x0000000100000002)
12:16:15.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 16afc913be4442278554da31226401e4 for table 'replication_test_table' with partition [0x0000000200000000, 0x0000000200000001)
12:16:15.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6a07f1f4846c4dc89d48f0eb12f82116 for table 'replication_test_table' with partition [0x0000000200000001, 0x0000000200000002)
12:16:15.760 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[NonCoveredRange{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x0000000000000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299999, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299999, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000000000002, upperBoundPartitionKey=0x0000000100000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299999, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299999, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000100000002, upperBoundPartitionKey=0x0000000200000000, ttl=299999}, Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299999, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)[L],d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299999, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}, NonCoveredRange{lowerBoundPartitionKey=0x0000000200000002, upperBoundPartitionKey=0x, ttl=299999}]
12:16:15.766 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='22a58542e5de5ecb0275fa0e3634c0000e55388c22c3d4a034129204af03c973'}]
12:16:15.767 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.767 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:16:15.767 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='cb4102edd75b00d428783e461c6e2a1f156c94c6547c07489b3de6729991dbaa'}]
12:16:15.768 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000000, upperBoundPartitionKey=0x0000000000000001, ttl=299998, tablet=647c61a50b44498fa3eeefd2a9e9edf1@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:15.768 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.769 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:16:15.769 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='389aa0bce0e0260dc85e9415b267f9346a51bc55d5f4e927ecb318ccf89a4daa'}]
12:16:15.769 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000000, upperBoundPartitionKey=0x0000000100000001, ttl=299998, tablet=813326281f7b43a6aed811d25f91295c@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:15.770 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.770 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.770 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:16:15.770 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000000000001, upperBoundPartitionKey=0x0000000000000002, ttl=299998, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:15.771 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='03f34e183dd709329505772fc1b534ae528deb33d90f8ca636e0502bc1d9c16f'}]
12:16:15.772 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.772 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 4
12:16:15.772 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000100000001, upperBoundPartitionKey=0x0000000100000002, ttl=299998, tablet=071109eb1eb6484b816f6e592158c4db@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:15.785 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.786 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.789 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.791 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.797 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.797 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.804 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.806 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.809 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.817 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:15.821 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.823 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb656bd74, L:/127.0.0.1:50966 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.823 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.830 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.830 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x314fd9ea, L:/127.0.0.1:50968 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.830 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.838 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2fa3cb94, L:/127.0.0.1:50984 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.847 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.851 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1fe8b756, L:/127.0.0.1:50996 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.852 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269148667904001) for scanner KuduScanner(table=replication_test_table, tablet=d3abe64b8dda4db0a7f9bf9b64d3c931, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:15.853 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [389aa0bce0e0260dc85e9415b267f9346a51bc55d5f4e927ecb318ccf89a4daa]
12:16:15.853 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [389aa0bce0e0260dc85e9415b267f9346a51bc55d5f4e927ecb318ccf89a4daa]
12:16:15.853 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:16:15.853 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:16:15.855 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.856 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 389aa0bce0e0260dc85e9415b267f9346a51bc55d5f4e927ecb318ccf89a4daa finished by subtask 1; deferring removal (restored in pending)
12:16:15.860 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='45d8a6877cb9ed241d610f3c361a7082114d559862e45b9316fe30032f01605e'}]
12:16:15.862 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.862 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:16:15.863 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000000, upperBoundPartitionKey=0x0000000200000001, ttl=299998, tablet=16afc913be4442278554da31226401e4@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)[L],9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)]}]
12:16:15.868 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.871 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.872 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.872 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269148667904001) for scanner KuduScanner(table=replication_test_table, tablet=071109eb1eb6484b816f6e592158c4db, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:15.872 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [03f34e183dd709329505772fc1b534ae528deb33d90f8ca636e0502bc1d9c16f]
12:16:15.872 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [03f34e183dd709329505772fc1b534ae528deb33d90f8ca636e0502bc1d9c16f]
12:16:15.873 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 4 because it is idle.
12:16:15.873 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 4
12:16:15.874 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.874 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.874 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 03f34e183dd709329505772fc1b534ae528deb33d90f8ca636e0502bc1d9c16f finished by subtask 2; deferring removal (restored in pending)
12:16:15.876 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='9876367e6ba9f8310aa55461c9991ad42ef98316707b75ce189616615f744085'}]
12:16:15.877 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:15.877 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 5
12:16:15.878 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x0000000200000001, upperBoundPartitionKey=0x0000000200000002, ttl=299997, tablet=6a07f1f4846c4dc89d48f0eb12f82116@[8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613),9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095),d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)[L]]}]
12:16:15.881 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.896 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.902 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x82b9e3ca, L:/127.0.0.1:51004 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.904 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] connecting to peer
12:16:15.916 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:15.917 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:15.917 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:15.917 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.917 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] Successfully connected to peer
12:16:15.917 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.917 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:15.917 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.918 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.918 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:15.918 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.918 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.918 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:15.918 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:15.919 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.131
12:16:15.926 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269148667904001) for scanner KuduScanner(table=replication_test_table, tablet=813326281f7b43a6aed811d25f91295c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:15.926 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:108) Finished reading from splits [cb4102edd75b00d428783e461c6e2a1f156c94c6547c07489b3de6729991dbaa]
12:16:15.927 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:15.931 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x64709a1f, L:/127.0.0.1:51006 - R:/127.21.36.131:43095] using SASL/PLAIN
12:16:15.931 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [cb4102edd75b00d428783e461c6e2a1f156c94c6547c07489b3de6729991dbaa]
12:16:15.931 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
12:16:15.931 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
12:16:15.933 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.933 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split cb4102edd75b00d428783e461c6e2a1f156c94c6547c07489b3de6729991dbaa finished by subtask 3; deferring removal (restored in pending)
12:16:15.933 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.939 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269148667904001) for scanner KuduScanner(table=replication_test_table, tablet=16afc913be4442278554da31226401e4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:15.942 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:108) Finished reading from splits [45d8a6877cb9ed241d610f3c361a7082114d559862e45b9316fe30032f01605e]
12:16:15.942 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [45d8a6877cb9ed241d610f3c361a7082114d559862e45b9316fe30032f01605e]
12:16:15.943 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
12:16:15.943 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
12:16:15.944 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 45d8a6877cb9ed241d610f3c361a7082114d559862e45b9316fe30032f01605e finished by subtask 1; deferring removal (restored in pending)
12:16:15.944 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.944 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.978 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269148667904001) for scanner KuduScanner(table=replication_test_table, tablet=6a07f1f4846c4dc89d48f0eb12f82116, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:15.978 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [9876367e6ba9f8310aa55461c9991ad42ef98316707b75ce189616615f744085]
12:16:15.978 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [9876367e6ba9f8310aa55461c9991ad42ef98316707b75ce189616615f744085]
12:16:15.979 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 5 because it is idle.
12:16:15.979 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 5
12:16:15.979 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.979 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.980 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 9876367e6ba9f8310aa55461c9991ad42ef98316707b75ce189616615f744085 finished by subtask 2; deferring removal (restored in pending)
12:16:15.994 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.189:35221(127.21.36.189:35221)] disconnecting while in state READY
12:16:15.995 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.190:33455(127.21.36.190:33455)] disconnecting while in state READY
12:16:15.995 [DEBUG - main] (Connection.java:575) [peer master-127.21.36.188:41809(127.21.36.188:41809)] disconnecting while in state READY
12:16:15.995 [DEBUG - main] (Connection.java:575) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] disconnecting while in state READY
12:16:15.995 [DEBUG - main] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state READY
12:16:15.995 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.36.188:41809(127.21.36.188:41809)] handling channelInactive
12:16:15.995 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.36.190:33455(127.21.36.190:33455)] handling channelInactive
12:16:15.995 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state READY due to: connection closed
12:16:15.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state READY due to: connection closed
12:16:15.995 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:15.995 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.36.189:35221(127.21.36.189:35221)] handling channelInactive
12:16:15.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state READY due to: connection closed
12:16:15.998 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-1
12:16:15.998 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 28 thread-local buffer(s) from thread: kudu-nio-0
12:16:15.998 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:16:15.995 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] handling channelInactive
12:16:16.000 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] cleaning up while in state READY due to: connection closed
12:16:16.000 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
12:16:16.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512976002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:16.011 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 12 for job 1ca37d58d1e10dcfad9f21d692b10dbc (5104 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:16.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 12 as completed for source Source: KuduSource.
12:16:16.012 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split cb4102edd75b00d428783e461c6e2a1f156c94c6547c07489b3de6729991dbaa from pending
12:16:16.012 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 9876367e6ba9f8310aa55461c9991ad42ef98316707b75ce189616615f744085 from pending
12:16:16.012 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 03f34e183dd709329505772fc1b534ae528deb33d90f8ca636e0502bc1d9c16f from pending
12:16:16.012 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 45d8a6877cb9ed241d610f3c361a7082114d559862e45b9316fe30032f01605e from pending
12:16:16.012 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 12 complete: removed split 389aa0bce0e0260dc85e9415b267f9346a51bc55d5f4e927ecb318ccf89a4daa from pending
12:16:16.012 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 12 complete: removed 5 finished splits from enumerator state
12:16:16.013 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.013 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.013 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:16:16.013 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:16:16.028 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.028 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:16:16.028 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.028 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:16.039 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:16.039 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:16.039 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:16.040 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:16.040 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:16.040 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:16.040 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:16.040 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:16.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:16.041 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:16.041 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:16.041 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:16.041 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:16.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.069 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.069 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.070 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-4
12:16:16.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.070690 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 21931
12:16:16.085 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.086 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.086 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:16.086 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:16:16.093 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:16.093 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:16.093 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:16.094 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.094 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.094 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.094 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.094 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.094 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.095 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:16.111868 22127 connection.cc:573] client connection to 127.21.36.129:45281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:16:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:16.112391 22127 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:16:16.114 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:16.114 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:16.114 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:16.115 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.115 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.115 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.115 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.115 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.115 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.115 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:16.118 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:16.120177 22280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from unknown peer (error 108)
12:16:16.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.125960 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22108
12:16:16.129 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.129 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.129 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:16.129 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (2/4)#0] (SplitFetcher.java:128) Split fetcher 4 exited.
12:16:16.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:16.141526 22280 consensus_peers.cc:597] T d3abe64b8dda4db0a7f9bf9b64d3c931 P 9e24ca086a1e4322ad294d640b08f369 -> Peer d04ef4271a25405d8f61303c957c20e0 (127.21.36.129:45281): Couldn't send request to peer d04ef4271a25405d8f61303c957c20e0. Status: Network error: Client connection negotiation failed: client connection to 127.21.36.129:45281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:16:16.149 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.149 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.149 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:16:16.149 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-0
12:16:16.154 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:16.155 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:16.155 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:16.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.156 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.156 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.156 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.156 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:16.186 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:16.186 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:16.186 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:16.186 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.186 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.186 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:16.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.187 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.187 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:16.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.187 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.187 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:16.187 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:16.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.188063 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 22249
12:16:16.193 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:16.193 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:16.193 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:16.193 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.193 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.193 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.194 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.194 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.194 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:16.234 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:16.234 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:16.235 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:16.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:16.236 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:16.237 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:16.237 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:16.237 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.237 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.237 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.237 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.237 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.237 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.237 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.237 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.237 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:16.245 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] handling channelInactive
12:16:16.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] cleaning up while in state READY due to: connection closed
12:16:16.246 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095) for tablet 647c61a50b44498fa3eeefd2a9e9edf1: connection closed
12:16:16.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.246587 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 21662
12:16:16.251 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)] connecting to peer
12:16:16.252 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281): Connection refused: /127.21.36.129:45281
12:16:16.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)] cleaning up while in state CONNECTING due to: Failed to connect to peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281): Connection refused: /127.21.36.129:45281
12:16:16.252 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281) for tablet 647c61a50b44498fa3eeefd2a9e9edf1: Failed to connect to peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281): Connection refused: /127.21.36.129:45281
12:16:16.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.271 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] connecting to peer
12:16:16.272 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613): Connection refused: /127.21.36.130:37613
12:16:16.272 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613): Connection refused: /127.21.36.130:37613
12:16:16.272 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613) for tablet 647c61a50b44498fa3eeefd2a9e9edf1: Failed to connect to peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613): Connection refused: /127.21.36.130:37613
12:16:16.276 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.36.190:33455(127.21.36.190:33455)] handling channelInactive
12:16:16.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state READY due to: connection closed
12:16:16.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.277109 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 21732
12:16:16.291 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.291 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.291 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.292 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.292 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.292 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.292 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.21.36.189:35221(127.21.36.189:35221)] Successfully connected to peer
12:16:16.292 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.21.36.188:41809(127.21.36.188:41809)] Successfully connected to peer
12:16:16.295 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.36.188
12:16:16.301 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:16.304 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809] using SASL/PLAIN
12:16:16.311 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.36.189:35221(127.21.36.189:35221)] handling channelInactive
12:16:16.312 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state READY due to: connection closed
12:16:16.312 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:16.313 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state NEGOTIATING due to: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221]
12:16:16.313 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221]
12:16:16.313 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.313 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.21.36.189:35221(127.21.36.189:35221)] handling channelInactive
12:16:16.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:16.317374 21650 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 21807
12:16:16.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.328 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:16.328 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:16.329 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:16.329 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.329 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.329 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.329 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.329 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.329 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.329 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.329 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.329 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.329 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:16.330 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.331 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.331 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.337 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.337 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.337 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:16.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:16.341 [DEBUG - pool-354-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:16.341 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:16.341 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:16.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:16.341 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:16.341 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:16.341 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:16.341 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:16.341 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:16.341 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:16.342 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:16.353 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.36.188:41809(127.21.36.188:41809)] handling channelInactive
12:16:16.353 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state READY due to: connection closed
12:16:16.353 [ERROR - kudu-nio-5] (Connection.java:452) [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:16.353 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state READY due to: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809]
12:16:16.354 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809]
12:16:16.354 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.357 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.21.36.188:41809(127.21.36.188:41809)] handling channelInactive
12:16:16.370 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.370 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.370 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.370 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.370 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.370 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.370 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.370 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.370 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.371 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.371 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.371 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.371 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.390 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.391 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.391 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.391 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.391 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.391 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.391 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.391 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.391 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.392 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.392 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.392 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.392 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.410 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.410 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.411 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.411 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.411 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.411 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.411 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.411 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.411 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.411 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.411 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.411 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.412 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.451 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.451 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.451 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.451 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.451 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.488 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:16.489 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:16.489 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:16.489 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.489 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.489 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.489 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.489 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.489 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.489 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.489 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.489 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.490 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:16.491 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.491 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.491 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.491 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.491 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.491 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.491 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.491 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.491 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.491 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.491 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.491 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.491 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512976502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:16.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 13 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:16.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 13 as completed for source Source: KuduSource.
12:16:16.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.571 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:16.571 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:16.571 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:16.571 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.571 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.571 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.571 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.571 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:16.571 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.571 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:16.571 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.572 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:16.572 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:16.611 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.611 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.611 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.611 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.611 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.611 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.612 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.619 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.734 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:16.734 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:16.734 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:16.734 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.734 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.734 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.734 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.734 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:16.734 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.734 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.734 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:16.734 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:16.735 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:16.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.801 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:16.801 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:16.801 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:16.802 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.802 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.802 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.802 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:16.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.802 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:16.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:16.802 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:16.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:16.850 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.850 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.850 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.851 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.851 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.851 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.851 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.851 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.851 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.851 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:16.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:16.910 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:16.911 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.911 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.911 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.911 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:16.911 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.911 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:16.911 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.911 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.911 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:16.911 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:16.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:16.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:16.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:16.957 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.957 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:16.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.957 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:16.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.958 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:16.958 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:17.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512977001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:17.010 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 14 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:17.011 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 14 as completed for source Source: KuduSource.
12:16:17.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.119 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.151 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:17.151 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:17.151 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:17.151 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:17.151 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:17.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:17.151 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:17.151 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:17.151 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:17.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:17.151 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:17.152 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:17.152 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:17.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.312 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:17.312 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:17.312 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:17.312 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:17.312 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:17.312 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:17.312 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:17.312 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:17.312 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:17.313 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:17.313 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:17.313 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:17.313 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:17.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:17Z chronyd exiting
12:16:17.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:17.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:17.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:17.434 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.434 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.434 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.434 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.434 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.435 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.435 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:17.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:17.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:17.457 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:17.457 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.457 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.458 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.458 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.458 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.458 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.458 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:17.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512977501 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:17.509 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 15 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:16:17.509 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 15 as completed for source Source: KuduSource.
12:16:17.533 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:17.533 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:17.533 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:17.533 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.533 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.533 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:17.533 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.534 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:17.534 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.534 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.534 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:17.534 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:17.534 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:17.534 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:17.535 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:17.535 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:17.535 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:17.535 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:17.535 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:17.535 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:17.535 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:17.535 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:17.535 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:17.535 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:17.535 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:17.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.618 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.774 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:17.774 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:17.774 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:17.774 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.774 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.774 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.774 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.775 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.775 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:17.775 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:17.775 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:17.775 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:17.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:17.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:17.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:17.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:17.942 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:17.942 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:17.942 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:17.943 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:17.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:17.943 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:17.943 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:17.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:17.943 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:17.943 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:18.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512978002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:18.009 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 16 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:16:18.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 16 as completed for source Source: KuduSource.
12:16:18.013 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:18.013 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:18.013 [DEBUG - pool-346-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:18.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:18.014 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [95ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [136ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [136ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [169ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [169ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [208ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [295ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1480ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6580ms] refreshing cache from master, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6581ms] too many traces: truncated at 100 traces, deferred=Deferred@70334297(state=PENDING, result=null, callback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702), errback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702)))
12:16:18.015 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:18.015 [WARN - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [95ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [136ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [136ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [169ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [169ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [208ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [295ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1480ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6580ms] refreshing cache from master, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6581ms] too many traces: truncated at 100 traces, deferred=Deferred@70334297(state=PENDING, result=null, callback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702), errback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.015 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
12:16:18.017 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
12:16:18.018 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28168), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [95ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [125ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [136ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [136ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [169ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [169ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [202ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [207ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [208ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [295ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [295ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [483ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [483ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [701ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [702ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1480ms] refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6580ms] refreshing cache from master, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6581ms] too many traces: truncated at 100 traces, deferred=Deferred@70334297(state=PENDING, result=null, callback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702), errback=(continuation of Deferred@671233711 after retry RPC after error@886865081) -> (continuation of Deferred@443466882 after retry RPC after error@392733545) -> (continuation of Deferred@778459237 after retry RPC after error@2030616740) -> (continuation of Deferred@363741651 after retry RPC after error@1200610276) -> (continuation of Deferred@1538655744 after retry RPC after error@1678045234) -> (continuation of Deferred@63145400 after retry RPC after error@984231647) -> (continuation of Deferred@1363650956 after retry RPC after error@310462198) -> (continuation of Deferred@225505115 after retry RPC after error@1724376316) -> (continuation of Deferred@178268769 after retry RPC after error@302934837) -> (continuation of Deferred@411980824 after retry RPC after error@1094165489) -> (continuation of Deferred@1255107220 after retry RPC after error@737797947) -> (continuation of Deferred@1094535368 after retry RPC after error@1030308661) -> (continuation of Deferred@205723078 after retry RPC after error@1760033610) -> (continuation of Deferred@1127716246 after retry RPC after error@875562542) -> (continuation of Deferred@541706315 after retry RPC after error@2007190179) -> (continuation of Deferred@147323620 after retry RPC after error@1014144164) -> (continuation of Deferred@1385627889 after retry RPC after error@1057799762) -> (continuation of Deferred@145449869 after retry RPC after error@546589056) -> (continuation of Deferred@1248740843 after retry RPC after error@273321178) -> (continuation of Deferred@1135489621 after retry RPC after error@1098165225) -> (continuation of Deferred@2039349041 after retry RPC after error@1038454918) -> (continuation of Deferred@267067893 after retry RPC after error@1797584898) -> (continuation of Deferred@2110191136 after retry RPC after error@1815488702)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.019 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:18.019 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
12:16:18.019 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
12:16:18.019 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:16:18.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.185 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:18.186 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:18.186 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:18.186 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.186 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.186 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.186 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.186 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.186 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.186 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:18.193 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:18.193 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:18.193 [DEBUG - pool-348-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:18.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.194 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.194 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.194 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.194 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.194 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.194 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.194 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:18.195 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [17ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [107ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [138ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [139ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [265ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1703ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3023ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3561ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3563ms] too many traces: truncated at 100 traces, deferred=Deferred@835418706(state=PENDING, result=null, callback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713), errback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713)))
12:16:18.195 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:18.195 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [17ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [107ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [138ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [139ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [265ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1703ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3023ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3561ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3563ms] too many traces: truncated at 100 traces, deferred=Deferred@835418706(state=PENDING, result=null, callback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713), errback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
12:16:18.197 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
12:16:18.198 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28343), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [17ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [56ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [107ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [107ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [138ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [138ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [139ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [140ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [140ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [163ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [168ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [168ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [183ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [204ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [204ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [265ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [265ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1702ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1703ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [3023ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3023ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3561ms] refreshing cache from master, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3562ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3563ms] too many traces: truncated at 100 traces, deferred=Deferred@835418706(state=PENDING, result=null, callback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713), errback=(continuation of Deferred@2010126163 after retry RPC after error@2139745108) -> (continuation of Deferred@286264306 after retry RPC after error@2070145640) -> (continuation of Deferred@209588440 after retry RPC after error@1016961352) -> (continuation of Deferred@767777458 after retry RPC after error@1226298824) -> (continuation of Deferred@898888930 after retry RPC after error@1704230081) -> (continuation of Deferred@1379249163 after retry RPC after error@628857360) -> (continuation of Deferred@266686137 after retry RPC after error@1230068208) -> (continuation of Deferred@914092325 after retry RPC after error@1328105184) -> (continuation of Deferred@1780238650 after retry RPC after error@692126544) -> (continuation of Deferred@1079655812 after retry RPC after error@1170304297) -> (continuation of Deferred@1293728050 after retry RPC after error@1827039298) -> (continuation of Deferred@2109857351 after retry RPC after error@866606323) -> (continuation of Deferred@467318428 after retry RPC after error@1151429085) -> (continuation of Deferred@937534696 after retry RPC after error@1042822691) -> (continuation of Deferred@1887963436 after retry RPC after error@1068005729) -> (continuation of Deferred@97803416 after retry RPC after error@2050161455) -> (continuation of Deferred@1245924396 after retry RPC after error@912021364) -> (continuation of Deferred@290192827 after retry RPC after error@2093848382) -> (continuation of Deferred@750753447 after retry RPC after error@2022474675) -> (continuation of Deferred@912531260 after retry RPC after error@637541033) -> (continuation of Deferred@1994041952 after retry RPC after error@1792486931) -> (continuation of Deferred@2094813578 after retry RPC after error@1521474026) -> (continuation of Deferred@2038817141 after retry RPC after error@712114144) -> (continuation of Deferred@884976421 after retry RPC after error@276518097) -> (continuation of Deferred@1185124834 after retry RPC after error@1669916713)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.199 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:18.199 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
12:16:18.199 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
12:16:18.231 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:18.231 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:18.231 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:18.231 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:18.231 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:18.231 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:18.231 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:18.231 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:18.231 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:18.231 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:18.231 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:18.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:18.232 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:18.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.265 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:18.265 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:18.265 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:18.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.265 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.265 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.265 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:18.284 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:16:18.285 [INFO - flink-pekko.actor.default-dispatcher-4] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:16:18.285 [INFO - flink-pekko.actor.default-dispatcher-4] (MasterHooks.java:201) No master state to restore
12:16:18.285 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:16:18.286 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED.
12:16:18.286 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:18.286 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING.
12:16:18.286 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #3) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 71b57ea17b002970ac3f421ada230e68
12:16:18.287 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:16:18.288 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 71b57ea17b002970ac3f421ada230e68.
12:16:18.288 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
12:16:18.288 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
12:16:18.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4d37eea0
12:16:18.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:18.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:16:18.289 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:16:18.289 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
12:16:18.291 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6414a57d
12:16:18.292 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:18.293 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.294 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.294 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#3] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.295 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.313 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.314 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.315 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.315 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.315 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.315 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.333 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.334 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.334 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.334 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.334 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.335 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.335 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.335 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.335 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.354 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.354 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.354 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.354 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.354 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.354 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.355 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.373 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.373 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.374 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.374 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.374 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.374 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.374 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.374 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.394 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.394 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.394 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.394 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.394 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.394 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.395 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.395 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.413 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.414 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.414 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.414 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.414 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:18.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:18.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:18.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.451 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.451 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.451 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.452 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.452 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.452 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
.12:16:18.463 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512978463
12:16:18.464 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512978463
12:16:18.469 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:16:18.473 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:16:18.474 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:16:18.474 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:16:18.474 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:16:18.474 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:16:18.475 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:18.475 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:18.476 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:18.476 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.476 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.476 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.476 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.476 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.476 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.476 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.476 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:18.478 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:16:18.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512978502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:18.509 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 17 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
12:16:18.509 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 17 as completed for source Source: KuduSource.
12:16:18.513 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.513 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.514 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.514 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.514 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.514 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.514 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.514 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.514 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.555 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:18.555 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:18.555 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:18.555 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.556 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.556 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.556 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.556 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.556 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:18.568 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.573 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:18.573 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:18.573 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:18.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:18.573 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.573 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.573 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:18.573 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.573 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.573 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:18.574 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:18.734 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:18.734 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:18.735 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:18.735 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.735 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.735 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.735 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.735 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.735 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.735 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.735 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.735 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.735 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:18.737 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:18.737 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:18.737 [DEBUG - pool-344-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:18.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.737 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.737 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:18.737 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.737 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.737 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:18.737 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.737 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:18.737 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:18.738 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28895), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [99ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [99ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [156ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [158ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [184ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [186ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [200ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [228ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [228ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [264ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [761ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [781ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2082ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1481616401(state=PENDING, result=null, callback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723), errback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723)))
12:16:18.739 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:18.739 [WARN - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28895), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [99ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [99ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [156ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [158ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [184ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [186ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [200ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [228ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [228ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [264ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [761ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [781ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2082ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1481616401(state=PENDING, result=null, callback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723), errback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.739 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6).
12:16:18.740 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#6 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
12:16:18.742 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28895), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [22ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [24ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [99ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [99ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [156ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [158ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [184ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [186ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [186ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [186ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [200ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [201ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [201ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [221ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [228ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [228ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [262ms] refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [263ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [264ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [264ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [441ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [442ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [442ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [522ms] refreshing cache from master, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [523ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [524ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [524ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [761ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [761ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [781ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [781ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2080ms] refreshing cache from master, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2082ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [6000ms] refreshing cache from master, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [6001ms] too many traces: truncated at 100 traces, deferred=Deferred@1481616401(state=PENDING, result=null, callback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723), errback=(continuation of Deferred@157517413 after retry RPC after error@618508113) -> (continuation of Deferred@609270455 after retry RPC after error@31106312) -> (continuation of Deferred@345988088 after retry RPC after error@1576130845) -> (continuation of Deferred@2085963030 after retry RPC after error@678645105) -> (continuation of Deferred@1188926236 after retry RPC after error@364348395) -> (continuation of Deferred@1134303678 after retry RPC after error@1899420793) -> (continuation of Deferred@1532617776 after retry RPC after error@1926798443) -> (continuation of Deferred@1370106471 after retry RPC after error@381215039) -> (continuation of Deferred@39120828 after retry RPC after error@886640729) -> (continuation of Deferred@874573239 after retry RPC after error@1707102997) -> (continuation of Deferred@1078749470 after retry RPC after error@1013703318) -> (continuation of Deferred@261488121 after retry RPC after error@1747603429) -> (continuation of Deferred@1259200359 after retry RPC after error@672267202) -> (continuation of Deferred@139178252 after retry RPC after error@841253511) -> (continuation of Deferred@402101571 after retry RPC after error@815772564) -> (continuation of Deferred@1695135578 after retry RPC after error@1932468678) -> (continuation of Deferred@1490677613 after retry RPC after error@362280177) -> (continuation of Deferred@1032594046 after retry RPC after error@925304088) -> (continuation of Deferred@538060310 after retry RPC after error@176717465) -> (continuation of Deferred@1456157284 after retry RPC after error@1506533984) -> (continuation of Deferred@1759006169 after retry RPC after error@569219821) -> (continuation of Deferred@775603366 after retry RPC after error@677706723)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.743 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#6) of source Source: KuduSource.
12:16:18.743 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_6.
12:16:18.744 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:18.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:18.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:18.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:18.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:18.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:18.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:18.754 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:18.814 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:18.814 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:18.814 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:18.814 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.814 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.814 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.814 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.814 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.814 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.815 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.815 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.815 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.815 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:18.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:18.839 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:16:18.839 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:16:18.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:18.842463 23993 mini_oidc.cc:150] Starting JWKS server
12:16:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:18.845679 23993 webserver.cc:533] Webserver started at http://127.0.0.1:34363/ using document root <none> and password file <none>
12:16:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:18.846134 23993 mini_oidc.cc:186] Starting OIDC Discovery server
12:16:18.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:18.847888 23993 webserver.cc:533] Webserver started at http://127.0.0.1:44587/ using document root <none> and password file <none>
12:16:18.877 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.878 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.878 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.878 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.878 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.878 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.878 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.878 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.878 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.878 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.879 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [76ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [83ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [800ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [801ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2900ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5021ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1228859473(state=PENDING, result=null, callback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497), errback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497)))
12:16:18.879 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.879 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.879 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.880 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.880 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.880 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.880 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.879 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [76ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [83ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [800ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [801ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2900ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5021ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1228859473(state=PENDING, result=null, callback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497), errback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [76ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [83ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [800ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [801ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2900ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5021ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1228859473(state=PENDING, result=null, callback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497), errback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.880 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.880 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.880 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.880 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.880 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.880 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.884 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [76ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [83ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [800ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [801ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2900ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5021ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1228859473(state=PENDING, result=null, callback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497), errback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=28964), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [31ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [31ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [76ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [76ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [83ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [124ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [222ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [580ms] refreshing cache from master, [580ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [581ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [582ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [582ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [800ms] refreshing cache from master, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [800ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [801ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [801ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2900ms] refreshing cache from master, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [2900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [2900ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [2901ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [2901ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [5021ms] refreshing cache from master, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [5022ms] too many traces: truncated at 100 traces, deferred=Deferred@1228859473(state=PENDING, result=null, callback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497), errback=(continuation of Deferred@1007914637 after retry RPC after error@1703494344) -> (continuation of Deferred@693000277 after retry RPC after error@395067725) -> (continuation of Deferred@936104663 after retry RPC after error@419125732) -> (continuation of Deferred@1126966878 after retry RPC after error@912228703) -> (continuation of Deferred@1609277481 after retry RPC after error@488498761) -> (continuation of Deferred@1059143010 after retry RPC after error@1966999200) -> (continuation of Deferred@2010520262 after retry RPC after error@93029851) -> (continuation of Deferred@871854629 after retry RPC after error@922319357) -> (continuation of Deferred@1908299214 after retry RPC after error@683844479) -> (continuation of Deferred@539789848 after retry RPC after error@1575430513) -> (continuation of Deferred@1584662310 after retry RPC after error@1662029516) -> (continuation of Deferred@656975100 after retry RPC after error@1130413513) -> (continuation of Deferred@1037291444 after retry RPC after error@1523732524) -> (continuation of Deferred@943653070 after retry RPC after error@2130148597) -> (continuation of Deferred@1568322288 after retry RPC after error@358734403) -> (continuation of Deferred@1436062033 after retry RPC after error@273502147) -> (continuation of Deferred@405312008 after retry RPC after error@58781836) -> (continuation of Deferred@310635444 after retry RPC after error@1758109040) -> (continuation of Deferred@883878579 after retry RPC after error@808351802) -> (continuation of Deferred@1031666624 after retry RPC after error@31506434) -> (continuation of Deferred@1113086463 after retry RPC after error@24380966) -> (continuation of Deferred@1392860723 after retry RPC after error@1415738497)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.62:34839
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:18.885 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:18.885 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
12:16:18.885 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
12:16:18.885 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
12:16:18.886 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to CANCELING.
12:16:18.886 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
12:16:18.887 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:18.887 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
12:16:18.887 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
12:16:18.888 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
12:16:18.888 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from CANCELING to CANCELED.
12:16:18.889 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:16:18.897 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.897 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.897 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.897 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.897 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.898 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.898 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.898 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.898 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.898 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:16:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:18Z Disabled control of system clock
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:18.911733 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/logs
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data/info.pb
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.126:40817
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.126
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:18.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json with env {}
12:16:18.918 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.918 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.918 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.918 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.918 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.918 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.918 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.937 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.937 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.937 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.938 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.938 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.938 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.938 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.938 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.938 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.938 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.957 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.957 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.957 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.957 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.957 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.957 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.958 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:18.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:18.974 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:18.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:18.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.975 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.975 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.975 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:18.975 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:18.975 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:18.977 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:18.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:18.978 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:18.978 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.978 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.978 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.978 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.978 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.978 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:18.978 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.978 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:18.978 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:18.978 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:18.995 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:18.995 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:18.995 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:18.995 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.995 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.995 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.995 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.995 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.995 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.996 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:18.996 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:18.996 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:18.996 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:19.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512979002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:19.009 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 18 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
12:16:19.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 18 as completed for source Source: KuduSource.
12:16:19.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:19.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:19.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:19.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:19.018 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:19.018 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:19.018 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:19.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:19.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:19.018 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:19.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:19.018 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:19.018 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:19.037 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:19.037 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:19.037 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:19.038 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.038 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.038 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.038 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.038 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.038 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.038 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.038 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.038 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.038 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:19.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.067 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.073 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:19.074 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:19.074 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:19.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.074 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.074 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.074 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.074 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.074 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.074 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.074 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.074 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:19.101 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:19.101 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:19.101 [DEBUG - pool-350-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:19.101 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:19.101 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:19.101 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:19.101 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:19.101 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:19.101 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:19.101 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:19.101 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:19.101 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:19.101 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:19.102 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29249), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [53ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [96ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [96ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [110ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [113ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [113ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [114ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [149ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [183ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [224ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [301ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [302ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [302ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [382ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [641ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [641ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [641ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [641ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1080ms] refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1081ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1541ms] refreshing cache from master, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1542ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1543ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1543ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [5020ms] refreshing cache from master, [5020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [5021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [5021ms] too many traces: truncated at 100 traces, deferred=Deferred@68329973(state=PENDING, result=null, callback=(continuation of Deferred@18091091 after retry RPC after error@1538987035) -> (continuation of Deferred@2123036415 after retry RPC after error@1871117778) -> (continuation of Deferred@1313932005 after retry RPC after error@1296686328) -> (continuation of Deferred@1692264096 after retry RPC after error@1013841796) -> (continuation of Deferred@2062390470 after retry RPC after error@2034252159) -> (continuation of Deferred@1923295249 after retry RPC after error@560035870) -> (continuation of Deferred@935101264 after retry RPC after error@1339019033) -> (continuation of Deferred@617059665 after retry RPC after error@248297567) -> (continuation of Deferred@1572408533 after retry RPC after error@1824503676) -> (continuation of Deferred@1959451303 after retry RPC after error@523209249) -> (continuation of Deferred@174453429 after retry RPC after error@460370130) -> (continuation of Deferred@969760505 after retry RPC after error@1523623267) -> (continuation of Deferred@2139423958 after retry RPC after error@1634586068) -> (continuation of Deferred@839155094 after retry RPC after error@1830825224) -> (continuation of Deferred@978597838 after retry RPC after error@903368253) -> (continuation of Deferred@614559197 after retry RPC after error@1216699436) -> (continuation of Deferred@1400170677 after retry RPC after error@606797120) -> (continuation of Deferred@189445021 after retry RPC after error@1775041252) -> (continuation of Deferred@495552040 after retry RPC after error@1849341988) -> (continuation of Deferred@808597541 after retry RPC after error@1042804509) -> (continuation of Deferred@1875805751 after retry RPC after error@1418655858) -> (continuation of Deferred@1968968150 after retry RPC after error@1954695015), errback=(continuation of Deferred@18091091 after retry RPC after error@1538987035) -> (continuation of Deferred@2123036415 after retry RPC after error@1871117778) -> (continuation of Deferred@1313932005 after retry RPC after error@1296686328) -> (continuation of Deferred@1692264096 after retry RPC after error@1013841796) -> (continuation of Deferred@2062390470 after retry RPC after error@2034252159) -> (continuation of Deferred@1923295249 after retry RPC after error@560035870) -> (continuation of Deferred@935101264 after retry RPC after error@1339019033) -> (continuation of Deferred@617059665 after retry RPC after error@248297567) -> (continuation of Deferred@1572408533 after retry RPC after error@1824503676) -> (continuation of Deferred@1959451303 after retry RPC after error@523209249) -> (continuation of Deferred@174453429 after retry RPC after error@460370130) -> (continuation of Deferred@969760505 after retry RPC after error@1523623267) -> (continuation of Deferred@2139423958 after retry RPC after error@1634586068) -> (continuation of Deferred@839155094 after retry RPC after error@1830825224) -> (continuation of Deferred@978597838 after retry RPC after error@903368253) -> (continuation of Deferred@614559197 after retry RPC after error@1216699436) -> (continuation of Deferred@1400170677 after retry RPC after error@606797120) -> (continuation of Deferred@189445021 after retry RPC after error@1775041252) -> (continuation of Deferred@495552040 after retry RPC after error@1849341988) -> (continuation of Deferred@808597541 after retry RPC after error@1042804509) -> (continuation of Deferred@1875805751 after retry RPC after error@1418655858) -> (continuation of Deferred@1968968150 after retry RPC after error@1954695015)))
12:16:19.137 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:19.137 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:19.137 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:19.138 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.138 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.138 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.138 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.138 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.138 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.138 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.138 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.138 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.138 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:19.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.220948 24008 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:19.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.221549 24008 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:19.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.222028 24008 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:19.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.255870 24008 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:19.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.256173 24008 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:19.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.256384 24008 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:19.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.256646 24008 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:19.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.256907 24008 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:19.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.257058 24008 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34363/jwks.json
12:16:19.267 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:19.268 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:19.268 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:19.268 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:19.268 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:19.268 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:19.268 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:19.268 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:19.268 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:19.268 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:19.268 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:19.268 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:19.268 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:19.295737 24008 master_runner.cc:387] Master server non-default flags:
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.126:40817
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data/info.pb
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.126
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/logs
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:19.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:19.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:19.297168 24008 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:19.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:19.298848 24008 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:19.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.309978 24014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:19.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.358 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:19.358 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:19.358 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:19.358 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.358 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.358 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.358 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.358 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.359 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.359 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.359 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.358 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.359 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:19.395 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:19.395 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:19.395 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:19.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:19.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:19.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:19.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:19.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:19.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:19.396 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:19.397 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:19.397 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:19.397 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:19.413 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:19.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:19.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:19.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.414 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:19.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:19.415 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:19.415 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:19.415 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:19.415 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:19.415 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:19.416 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:19.416 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:19.416 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:19.416 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:19.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:19.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:19.416 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:19.416 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:19.416 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:19.417 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:19.458 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:19.458 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:19.458 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:19.459 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.459 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.459 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.459 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.459 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:19.459 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:19.459 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.459 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.459 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:19.459 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:19.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512979502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:19.518 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 19 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=16 ms, finalizationTime=0 ms).
12:16:19.520 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 19 as completed for source Source: KuduSource.
12:16:19.530 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:19.530 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:19.530 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:19.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.531 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.531 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.531 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.531 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.531 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.531 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.531 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.531 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:19.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.567 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:19.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:19.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:19.891 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:19.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.892 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.892 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:19.892 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:19.892 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.892 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.892 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:19.892 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:20.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512980002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:20.007 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:20.007 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:20.008 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:20.008 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.008 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.008 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.008 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.009 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.009 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.009 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.009 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.009 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.009 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:20.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:20.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:20.011 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:20.012 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.012 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.012 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.012 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.012 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.012 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.012 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.013 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.013 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.013 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:20.019 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 20 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:16:20.020 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 20 as completed for source Source: KuduSource.
12:16:20.046 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:20.046 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:20.046 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:20.047 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.047 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.047 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.047 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.047 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.047 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.047 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.047 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.047 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:20.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.067 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:20.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:20.178 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:20.178 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:20.178 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:20.178 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:20.179 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:20.179 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:20.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:20.179 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:20.179 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:20.179 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:20.179 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:20.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:20.192 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:20.192 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:20.192 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.192 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.192 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:20.193 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.193 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.193 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:20.193 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.193 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.193 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:20.193 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:20.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.261 [DEBUG - pool-354-thread-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [7ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [29ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [32ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [123ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [123ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [343ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [343ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [682ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1324ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3062ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [5262ms] refreshing cache from master, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5263ms] too many traces: truncated at 100 traces, deferred=Deferred@56561428(state=PENDING, result=null, callback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178), errback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178)))
12:16:20.262 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:20.263 [WARN - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [7ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [29ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [32ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [123ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [123ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [343ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [343ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [682ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1324ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3062ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [5262ms] refreshing cache from master, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5263ms] too many traces: truncated at 100 traces, deferred=Deferred@56561428(state=PENDING, result=null, callback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178), errback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1407)
		at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
		at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
		... 1 more
12:16:20.317 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:16:20.322 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.322 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:16:20.329 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=30005), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [6ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [7ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [7ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [22ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [29ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [31ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [32ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [43ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [44ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [44ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [62ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [63ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [82ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [82ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [123ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [123ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [202ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [203ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [203ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [342ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [343ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [343ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [442ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [442ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [681ms] refreshing cache from master, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [682ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [682ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1324ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3062ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [5262ms] refreshing cache from master, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [5262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [5263ms] too many traces: truncated at 100 traces, deferred=Deferred@56561428(state=PENDING, result=null, callback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178), errback=(continuation of Deferred@1158997647 after retry RPC after error@1685509347) -> (continuation of Deferred@877019103 after retry RPC after error@1335534060) -> (continuation of Deferred@769136142 after retry RPC after error@2136673946) -> (continuation of Deferred@2053537385 after retry RPC after error@1617507592) -> (continuation of Deferred@233584493 after retry RPC after error@711251860) -> (continuation of Deferred@1664643463 after retry RPC after error@1255201181) -> (continuation of Deferred@644598005 after retry RPC after error@717186011) -> (continuation of Deferred@170629954 after retry RPC after error@1182513067) -> (continuation of Deferred@1043330033 after retry RPC after error@1868557908) -> (continuation of Deferred@972589430 after retry RPC after error@581285645) -> (continuation of Deferred@1666480339 after retry RPC after error@1936267171) -> (continuation of Deferred@245863297 after retry RPC after error@28659847) -> (continuation of Deferred@1105666690 after retry RPC after error@2047402258) -> (continuation of Deferred@1208049225 after retry RPC after error@1671110310) -> (continuation of Deferred@462476133 after retry RPC after error@640528756) -> (continuation of Deferred@1679577326 after retry RPC after error@1607011557) -> (continuation of Deferred@1121974146 after retry RPC after error@154290364) -> (continuation of Deferred@263189076 after retry RPC after error@404126048) -> (continuation of Deferred@633929223 after retry RPC after error@1042560426) -> (continuation of Deferred@1315528040 after retry RPC after error@1696592060) -> (continuation of Deferred@130355934 after retry RPC after error@408157929) -> (continuation of Deferred@483746454 after retry RPC after error@106294176) -> (continuation of Deferred@690575958 after retry RPC after error@772427052) -> (continuation of Deferred@427576233 after retry RPC after error@819833805) -> (continuation of Deferred@1397075050 after retry RPC after error@802879491) -> (continuation of Deferred@1409343314 after retry RPC after error@165578204) -> (continuation of Deferred@1996902001 after retry RPC after error@266648178)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.sendRpcToTablet(AsyncKuduClient.java:1407)
		at org.apache.kudu.client.AsyncKuduClient.lambda$delayedSendRpcToTablet$18(AsyncKuduClient.java:2343)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
		at org.apache.kudu.shaded.io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
		at org.apache.kudu.shaded.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
		... 1 more
12:16:20.330 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:16:20.330 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:16:20.331 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:20.331 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
12:16:20.333 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:20.333 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:20.334 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:20.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.335 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.335 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.335 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.336 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:20.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:20.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:20.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:20.422 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:20.422 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:20.423 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:20.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:20.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:20.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:20.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:20.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:20.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:20.423 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:20.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512980502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:20.515 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 21 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:20.517 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 21 as completed for source Source: KuduSource.
12:16:20.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.757 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:20.757 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:20.757 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:20.757 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:20.757 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:20.757 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:20.757 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:20.757 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:20.758 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:20.758 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:20.758 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:20.757 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:20.758 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:20.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:20.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:20.777 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:20.778 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:20.778 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:20.778 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:20.778 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:20.778 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:20.778 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:20.778 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:20.778 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:20.779 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:20.779 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:20.793 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:20.793 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:20.793 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:20.794 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.794 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.794 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.794 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.794 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.794 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.794 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.795 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:20.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:19.310943 24015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.712194 24013 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 24008
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.879212 24013 kernel_stack_watchdog.cc:198] Thread 24008 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:16:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:16:20.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.884016 24008 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.574s	user 0.567s	sys 1.005s
12:16:20.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.884425 24008 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.575s	user 0.567s	sys 1.005s
12:16:20.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.885329 24016 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1575 milliseconds
12:16:20.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:20.886186 24017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:20.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.886240 24008 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:20.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.887542 24008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:20.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.890301 24008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:20.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.891700 24008 hybrid_clock.cc:648] HybridClock initialized: now 1783512980891652 us; error 47 us; skew 500 ppm
12:16:20.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.892637 24008 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:20.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.899565 24008 webserver.cc:533] Webserver started at http://127.23.110.126:39009/ using document root <none> and password file <none>
12:16:20.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.900650 24008 fs_manager.cc:362] Metadata directory not provided
12:16:20.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.900921 24008 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:20.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.901401 24008 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.906438 24008 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data/instance:
12:16:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb"
12:16:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:20 on dist-test-slave-vcgh"
12:16:20.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.907586 24008 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal/instance:
12:16:20.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb"
12:16:20.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:20 on dist-test-slave-vcgh"
12:16:20.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.915668 24008 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:16:20.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.921792 24024 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:20.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.923015 24008 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:16:20.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.923358 24008 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal
12:16:20.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb"
12:16:20.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:20 on dist-test-slave-vcgh"
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.923676 24008 fs_report.cc:389] FS layout report
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data/data
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:20.971 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:20.971 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:20.971 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:20.971 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.971 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.971 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.971 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.972 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.971 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:20.972 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:20.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:20.972 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:20.974 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:20.974 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:20.974 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:20.974 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:20.974 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:20.974 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:20.974 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:20.974 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:20.974 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:20.974 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:20.974 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:20.974 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:20.974 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:20.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.980331 24008 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:20.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.981899 24008 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:20.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:20.982407 24008 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:21.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512981001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:21.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 22 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:16:21.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 22 as completed for source Source: KuduSource.
12:16:21.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.059733 24008 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.126:40817
12:16:21.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.059849 24075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.126:40817 every 8 connection(s)
12:16:21.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.062578 24008 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/data/info.pb
12:16:21.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.065413 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24008
12:16:21.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.065985 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-0/wal/instance
12:16:21.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.069900 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.071192 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/logs
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data/info.pb
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.125:35201
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.125
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json with env {}
12:16:21.075 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:21.076 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:21.076 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:21.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:21.076 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:21.076 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:21.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:21.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:21.076 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:21.076 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:21.076 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:21.076 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:21.076 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:21.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.081583 24076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } has no permanent_uuid. Determining permanent_uuid...
12:16:21.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.106658 24076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } has no permanent_uuid. Determining permanent_uuid...
12:16:21.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.109297 24027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.113530 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.163075 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 1
12:16:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.167418 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.188 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:21.188 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:21.188 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:21.188 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.188 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.188 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.188 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.188 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.189 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.189 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.189 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:21.210 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:21.210 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:21.210 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:21.210 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.210 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.211 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.211 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.211 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.211 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.211 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.211 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.211 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:21.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.235782 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 2
12:16:21.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.240175 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.330 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:21.331 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:21.331 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:21.331 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:21.331 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:21.331 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:21.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:21.331 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:21.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:21.331 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:21.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:21.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.331714 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 3
12:16:21.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:21.332 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:21.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.335992 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.355 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:21.355 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:21.355 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:21.355 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.355 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.355 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.355 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.355 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.355 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.355 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.386687 24078 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.387305 24078 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.387813 24078 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:21.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.421506 24078 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.421811 24078 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.422022 24078 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.422232 24078 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.422513 24078 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.422725 24078 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34363/jwks.json
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.460712 24078 master_runner.cc:387] Master server non-default flags:
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.125:35201
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data/info.pb
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.125
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/logs
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:21.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.462244 24078 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:21.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.463869 24078 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:21.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.474586 24087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:21.478 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:21.478 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:21.478 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:21.478 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:21.478 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:21.479 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:21.479 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:21.479 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:21.479 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:21.479 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:21.479 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:21.479 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:21.479 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:21.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.480005 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 4
12:16:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.485284 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512981502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:21.512 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 23 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:16:21.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 23 as completed for source Source: KuduSource.
12:16:21.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.577 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:21.577 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:21.577 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:21.577 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:21.578 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:21.578 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:21.578 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:21.578 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:21.578 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:21.578 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:21.578 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:21.578 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:21.578 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:21.611 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:21.612 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:21.612 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:21.612 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.612 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.613 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:21.613 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.613 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.613 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:21.613 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.613 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:21.613 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:21.674 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:21.674 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:21.674 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:21.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:21.675 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:21.675 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:21.675 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:21.675 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:21.675 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:21.677 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:21.677 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:21.677 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:21.677 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:21.755 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:21.784708 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 5
12:16:21.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.792423 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:21.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:21.890 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:21.890 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:21.890 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:21.891 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:21.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:21.892 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.892 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.892 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:21.892 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:22.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 24 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512982002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:22.013 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 24 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:16:22.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 24 as completed for source Source: KuduSource.
12:16:22.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.074 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:22.074 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:22.074 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:22.075 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.075 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.075 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.075 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.075 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.075 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.075 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.075 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.075 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.075 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:22.154 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:22.154 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:22.154 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:22.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.155 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.155 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.155 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.155 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.155 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.155 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:22.156 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:22.156 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:22.156 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:22.156 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.156 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.156 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.156 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.157 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.157 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.157 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.157 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.157 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:22.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.284 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:22.284 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:22.285 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:22.285 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:22.285 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:22.285 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:22.286 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:22.286 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:22.286 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:22.287 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:22.287 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:22.287 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:22.287 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:22.294 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:22.295 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:22.295 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:22.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:22.296 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.296 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.296 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:22.296 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.296 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.296 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:22.296 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:22.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:22.339916 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 6
12:16:22.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:22.360869 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.125:35201: Network error: Client connection negotiation failed: client connection to 127.23.110.125:35201: connect: Connection refused (error 111)
12:16:22.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 25 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512982502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:22.515 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:22.515 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:22.515 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:22.516 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.516 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.516 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:22.516 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.516 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:22.516 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.516 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.516 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:22.517 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:22.523 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 25 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=20 ms, finalizationTime=1 ms).
12:16:22.524 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 25 as completed for source Source: KuduSource.
12:16:22.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:22.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:22.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:22.734 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:22.734 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:22.734 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:22.734 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:22.734 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:22.735 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:22.735 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:22.735 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:22.734 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:22.735 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:22.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:22.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:22.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:22.962 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:22.963 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:22.963 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:22.963 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:22.963 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:22.963 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:22.963 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:22.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:22.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:22.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:22.964 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:23.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 26 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512983002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:23.014 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 26 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:23.016 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 26 as completed for source Source: KuduSource.
12:16:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:22.881851 24086 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 24078
12:16:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.037741 24078 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.563s	user 0.606s	sys 0.952s
12:16:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.038143 24078 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.564s	user 0.606s	sys 0.952s
12:16:23.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:21.474815 24088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:23.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.039310 24089 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1563 milliseconds
12:16:23.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.040386 24078 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:23.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.040457 24090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:23.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.043602 24078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:23.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.046085 24078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:23.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.047452 24078 hybrid_clock.cc:648] HybridClock initialized: now 1783512983047413 us; error 39 us; skew 500 ppm
12:16:23.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.048283 24078 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:23.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.054618 24078 webserver.cc:533] Webserver started at http://127.23.110.125:38381/ using document root <none> and password file <none>
12:16:23.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.055511 24078 fs_manager.cc:362] Metadata directory not provided
12:16:23.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.055730 24078 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:23.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.056146 24078 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:23.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.060846 24078 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data/instance:
12:16:23.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "549876b8fda045de9e2733f54bfc6587"
12:16:23.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:23 on dist-test-slave-vcgh"
12:16:23.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.062100 24078 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal/instance:
12:16:23.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "549876b8fda045de9e2733f54bfc6587"
12:16:23.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:23 on dist-test-slave-vcgh"
12:16:23.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.069877 24078 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
12:16:23.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.075897 24100 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.077005 24078 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
12:16:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.077345 24078 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal
12:16:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "549876b8fda045de9e2733f54bfc6587"
12:16:23.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:23 on dist-test-slave-vcgh"
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.077725 24078 fs_report.cc:389] FS layout report
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data/data
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:23.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:23.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.140758 24078 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:23.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.142302 24078 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:23.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.142741 24078 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:23.174 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:23.174 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:23.174 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:23.174 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:23.175 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:23.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:23.175 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:23.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:23.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:23.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:23.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:23.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:23.175 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:23.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.214628 24078 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.125:35201
12:16:23.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.214725 24151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.125:35201 every 8 connection(s)
12:16:23.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.217617 24078 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/data/info.pb
12:16:23.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.223316 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:23.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.225260 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24078
12:16:23.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.225692 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-1/wal/instance
12:16:23.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.228539 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:23.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/logs
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data/info.pb
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.124:37703
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.124
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json with env {}
12:16:23.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.237313 24152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } has no permanent_uuid. Determining permanent_uuid...
12:16:23.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.264451 24152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } has no permanent_uuid. Determining permanent_uuid...
12:16:23.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.279465 24152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } has no permanent_uuid. Determining permanent_uuid...
12:16:23.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.282069 24104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.286518 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.335942 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 1
12:16:23.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.340662 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.409044 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 2
12:16:23.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.413349 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.421360 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } attempt: 7
12:16:23.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.438935 24076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } has no permanent_uuid. Determining permanent_uuid...
12:16:23.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.444829 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 27 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512983502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:23.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.503186 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 1
12:16:23.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.505306 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 3
12:16:23.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.510926 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 27 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:23.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.511905 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 27 as completed for source Source: KuduSource.
12:16:23.517 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:23.517 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:23.518 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:23.518 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.518 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.518 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.518 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.518 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.518 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.518 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.518 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.518 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.518 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:23.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.560144 24154 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:23.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.560794 24154 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:23.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.561389 24154 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:23.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.592334 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 2
12:16:23.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.596043 24154 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:23.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.596355 24154 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:23.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.596678 24154 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.596727 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.597035 24154 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.597249 24154 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:23.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.597404 24154 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34363/jwks.json
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.635864 24154 master_runner.cc:387] Master server non-default flags:
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.124:37703
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34363/jwks.json
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data/info.pb
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.124
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/logs
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:23.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:23.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.637228 24154 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:23.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.639077 24154 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:23.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.650034 24166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:23.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.655288 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 4
12:16:23.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.661417 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.682134 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 3
12:16:23.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.689592 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.708 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:23.708 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:23.708 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:23.708 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:23.709 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:23.709 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:23.709 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:23.709 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:23.709 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:23.709 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:23.709 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:23.709 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:23.709 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:23.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:23.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.830050 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 4
12:16:23.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.838285 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:23.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:23.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:23.886 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:23.887 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:23.887 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:23.887 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:23.887 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:23.887 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:23.887 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:23.887 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:23.888 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:23.888 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:23.888 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:23.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:23.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:23.897 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:23.897 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.898 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:23.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:23.898 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.898 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.898 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:23.898 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:23.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:23.942 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:23.943 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:23.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:23.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:23.943 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:23.943 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:23.943 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:23.944 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:23.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:23.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:23.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:23.944 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:23.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:23.960850 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 5
12:16:23.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.973659 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:24.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 28 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512984002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:24.014 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 28 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:24.015 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:24.015 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:24.015 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:24.016 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.016 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.016 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.017 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.017 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.017 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.017 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.017 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:24.018 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 28 as completed for source Source: KuduSource.
12:16:24.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.121779 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 5
12:16:24.130 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:24.130 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:24.130 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:24.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.130 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.130 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.131 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.131 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.131 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.131 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:24.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.136272 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:24.153 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:24.154 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:24.154 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:24.154 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.154 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.154 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.155 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.155 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.155 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.155 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.155 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.155 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:24.156 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:24.156 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:24.156 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:24.156 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.156 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.156 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:24.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:24.157 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.157 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.157 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:24.157 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:24.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:24.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:24.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:24.395 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.395 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.396 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.396 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:24.417 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:24.417 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:24.418 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:24.418 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:24.418 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:24.418 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:24.418 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:24.418 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:24.419 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:24.419 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:24.419 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:24.419 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:24.419 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:24.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 29 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512984502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:24.512 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:24.512 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:24.512 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:24.513 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.513 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.513 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.513 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:24.517 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 29 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=14 ms, finalizationTime=1 ms).
12:16:24.518 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 29 as completed for source Source: KuduSource.
12:16:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.521143 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 6
12:16:24.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.553349 24152 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:24.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:24.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:24.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:24.591 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:24.591 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:24.591 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:24.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:24.591 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:24.591 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:24.591 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:24.591 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:24.591 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:24.591 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:24.610 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:24.610 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:24.610 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:24.611 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.611 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.611 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.611 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.611 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:24.612 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:24.612 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:24.612 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.612 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.612 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.612 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.612 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.612 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.613 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.613 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:24.613 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:24.611 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.613 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:24.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:24.614 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:24.652 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:24.653 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:24.653 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:24.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.654 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.654 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.654 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.654 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:24.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.688791 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 6
12:16:24.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.709336 24076 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.110.124:37703: Network error: Client connection negotiation failed: client connection to 127.23.110.124:37703: connect: Connection refused (error 111)
12:16:24.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:24.831 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:24.831 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:24.831 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:24.831 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.831 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.832 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:24.832 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.832 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.832 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:24.832 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.832 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.832 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:24.832 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:24.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:23.650493 24167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:24.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.870885 24169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:24.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.872928 24168 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1217 milliseconds
12:16:24.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.874349 24154 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.224s	user 0.449s	sys 0.756s
12:16:24.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:24.874606 24154 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.225s	user 0.449s	sys 0.756s
12:16:24.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.874945 24154 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:24.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.876020 24154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:24.878 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:24.878 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:24.878 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:24.878 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:24.878 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:24.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.878603 24154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:24.878 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:24.878 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:24.878 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:24.879 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:24.879 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:24.879 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:24.879 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:24.879 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:24.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.880057 24154 hybrid_clock.cc:648] HybridClock initialized: now 1783512984880015 us; error 34 us; skew 500 ppm
12:16:24.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.881006 24154 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:24.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.888432 24154 webserver.cc:533] Webserver started at http://127.23.110.124:34387/ using document root <none> and password file <none>
12:16:24.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.889470 24154 fs_manager.cc:362] Metadata directory not provided
12:16:24.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.889657 24154 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:24.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.890096 24154 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:24.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.894754 24154 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data/instance:
12:16:24.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50e1cedcc9914a6189ca82537a7556b8"
12:16:24.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:24 on dist-test-slave-vcgh"
12:16:24.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.895895 24154 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal/instance:
12:16:24.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50e1cedcc9914a6189ca82537a7556b8"
12:16:24.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:24 on dist-test-slave-vcgh"
12:16:24.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.903986 24154 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
12:16:24.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.910358 24180 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:24.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.911597 24154 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:16:24.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.911935 24154 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal
12:16:24.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "50e1cedcc9914a6189ca82537a7556b8"
12:16:24.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:24 on dist-test-slave-vcgh"
12:16:24.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.912320 24154 fs_report.cc:389] FS layout report
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data/data
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:24.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.992174 24154 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.993798 24154 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:24.994199 24154 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:25.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 30 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512985002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:25.010 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 30 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:16:25.010 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 30 as completed for source Source: KuduSource.
12:16:25.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.069423 24154 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.124:37703
12:16:25.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.069509 24231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.124:37703 every 8 connection(s)
12:16:25.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.073330 24154 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/data/info.pb
12:16:25.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.074067 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24154
12:16:25.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.074445 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/master-2/wal/instance
12:16:25.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.080895 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:25.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.096577 24232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } has no permanent_uuid. Determining permanent_uuid...
12:16:25.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.118976 24232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } has no permanent_uuid. Determining permanent_uuid...
12:16:25.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.128441 24232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } has no permanent_uuid. Determining permanent_uuid...
12:16:25.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.144819 24232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: Bootstrap starting.
12:16:25.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.151336 24232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: Neither blocks nor log segments found. Creating new log.
12:16:25.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.153039 24232 log.cc:826] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: Log is configured to *not* fsync() on all Append() calls
12:16:25.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.157822 24232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: No bootstrap required, opened a new log
12:16:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.177462 24232 raft_consensus.cc:359] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.178133 24232 raft_consensus.cc:385] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.178413 24232 raft_consensus.cc:740] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e1cedcc9914a6189ca82537a7556b8, State: Initialized, Role: FOLLOWER
12:16:25.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.179198 24232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.181543 24241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.182215 24241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.182876 24232 sys_catalog.cc:565] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: configured and running, proceeding with master startup.
12:16:25.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:25.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:25.191 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:25.191 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.192 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.192 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.192 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.192 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.192 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.192 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.192 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:25.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:25.207130 24252 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:16:25.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:25.207435 24252 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:16:25.217 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:25.217 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:25.217 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:25.218 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.218 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.218 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.218 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:25.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.204013 24154 master_runner.cc:187] Error getting master registration for 127.23.110.126:40817: OK, instance_id { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" instance_seqno: 1783512981040126 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:16:25.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.233613 24154 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:16:25.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:25.249522 24186 tablet.cc:2406] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:25.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.330 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:25.330 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:25.330 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:25.330 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.330 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.330 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.330 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.330 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.330 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.330 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.331 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.331 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.331 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:25.418 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:25.418 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:25.418 [DEBUG - pool-352-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:25.418 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.418 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.418 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:25.419 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.419 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.419 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.419 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.419 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:25.419 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:25.419 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:25.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 31 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512985501 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:25.509 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 31 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:16:25.510 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 31 as completed for source Source: KuduSource.
12:16:25.548 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:25.548 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:25.548 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:25.548 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:25.548 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:25.548 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:25.548 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:25.548 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:25.548 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:25.548 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:25.548 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:25.548 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:25.548 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:25.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.568274 24241 raft_consensus.cc:493] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.568928 24241 raft_consensus.cc:515] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.571319 24241 leader_election.cc:290] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a29a9c3dc574f048d3b8d10fd2e42fb (127.23.110.126:40817), 549876b8fda045de9e2733f54bfc6587 (127.23.110.125:35201)
12:16:25.585 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:16:25.586 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:16:25.587 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:16:25.587 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 1 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:16:25.587 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to SCHEDULED.
12:16:25.588 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from SCHEDULED to DEPLOYING.
12:16:25.588 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #3) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 662c4bfa88ebb225fdaa868646c1528c
12:16:25.588 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:25.589 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 662c4bfa88ebb225fdaa868646c1528c.
12:16:25.593 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3), deploy into slot with allocation id 662c4bfa88ebb225fdaa868646c1528c.
12:16:25.593 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from CREATED to DEPLOYING.
12:16:25.594 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) [DEPLOYING].
12:16:25.594 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@54fb528c
12:16:25.595 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:25.595 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:16:25.595 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:16:25.596 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from DEPLOYING to INITIALIZING.
12:16:25.598 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@343eac3a
12:16:25.600 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:25.601 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.602 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.602 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.602 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.602 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.604 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#3] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.605 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.605 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.605 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.613 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.613 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.613 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.613 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.613921 24152 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 7
12:16:25.621 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.626 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.626 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.626 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.627 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.628 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.628 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.628 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.628 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.628 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.628 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.628 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.640558 24152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: Bootstrap starting.
12:16:25.641 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.642 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.642 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.643 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.643 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.643 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.643 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.643 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.643 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.643 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.643 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.644 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.647635 24152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: Neither blocks nor log segments found. Creating new log.
12:16:25.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.649924 24152 log.cc:826] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: Log is configured to *not* fsync() on all Append() calls
12:16:25.654 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:25.655 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:25.655 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:25.655 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.655 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.655 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.655 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.655 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.655 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.655 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.655 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.655 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.655 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:25.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.660009 24152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: No bootstrap required, opened a new log
12:16:25.662 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.662 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.662 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.662 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.662 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.662 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.662 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.662 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.662 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.662 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.662 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.662 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.681 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.681 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.681 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.682 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.682 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.682 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.682 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.682 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.682 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.682 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.682 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.682 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.682 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.690258 24152 raft_consensus.cc:359] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.691365 24152 raft_consensus.cc:385] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.691771 24152 raft_consensus.cc:740] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549876b8fda045de9e2733f54bfc6587, State: Initialized, Role: FOLLOWER
12:16:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.693162 24152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.697109 24266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.698004 24266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.698640 24152 sys_catalog.cc:565] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: configured and running, proceeding with master startup.
12:16:25.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.698807 24127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50e1cedcc9914a6189ca82537a7556b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549876b8fda045de9e2733f54bfc6587" is_pre_election: true
12:16:25.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.699702 24127 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50e1cedcc9914a6189ca82537a7556b8 in term 0.
12:16:25.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.701242 24183 leader_election.cc:304] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e1cedcc9914a6189ca82537a7556b8, 549876b8fda045de9e2733f54bfc6587; no voters: 
12:16:25.702 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.702 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.702 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.702 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.702180 24241 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:25.702 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.702 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.702 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.703 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.703 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.703 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.702517 24241 raft_consensus.cc:493] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:25.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.702819 24241 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 0 FOLLOWER]: Advancing to term 1
12:16:25.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.709515 24241 raft_consensus.cc:515] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.712086 24241 leader_election.cc:290] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [CANDIDATE]: Term 1 election: Requested vote from peers 1a29a9c3dc574f048d3b8d10fd2e42fb (127.23.110.126:40817), 549876b8fda045de9e2733f54bfc6587 (127.23.110.125:35201)
12:16:25.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.713073 24127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50e1cedcc9914a6189ca82537a7556b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "549876b8fda045de9e2733f54bfc6587"
12:16:25.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.713650 24127 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 0 FOLLOWER]: Advancing to term 1
12:16:25.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.721273 24127 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50e1cedcc9914a6189ca82537a7556b8 in term 1.
12:16:25.721 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.721 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.722 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.722 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.722 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.722 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.722 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.722 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.722 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.722 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.723802 24183 leader_election.cc:304] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50e1cedcc9914a6189ca82537a7556b8, 549876b8fda045de9e2733f54bfc6587; no voters: 
12:16:25.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.724561 24241 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 1 FOLLOWER]: Leader election won for term 1
12:16:25.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.734 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.735 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.735 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.735 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.735 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.735 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.735 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.735 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.735 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.735 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.735 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.739255 24241 raft_consensus.cc:697] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [term 1 LEADER]: Becoming Leader. State: Replica: 50e1cedcc9914a6189ca82537a7556b8, State: Running, Role: LEADER
12:16:25.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.740259 24241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.742 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.742 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.742 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.742 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.743 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.743 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.742794 24076 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } attempt: 7
12:16:25.743 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.762 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.762 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.762 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.763 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.763028 24272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50e1cedcc9914a6189ca82537a7556b8. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.764955 24272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: This master's current role is: LEADER
12:16:25.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.772468 24076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: Bootstrap starting.
12:16:25.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.777837 24281 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:16:25.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.778184 24280 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:16:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.782361 24076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: Neither blocks nor log segments found. Creating new log.
12:16:25.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.783221 24281 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:16:25.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.784653 24076 log.cc:826] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: Log is configured to *not* fsync() on all Append() calls
12:16:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.789367 24076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: No bootstrap required, opened a new log
12:16:25.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.815198 24127 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [term 1 FOLLOWER]: Refusing update from remote peer 50e1cedcc9914a6189ca82537a7556b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:25.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.781486 24078 master_runner.cc:187] Error getting master registration for 127.23.110.126:40817: OK, instance_id { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" instance_seqno: 1783512981040126 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:16:25.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.816936 24078 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:16:25.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.817242 24272 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:25.821 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:25.822 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:25.822 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:25.822 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.822 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.822 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:25.823 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.823 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.823 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:25.823 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.823 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.823 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:25.823 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.822942 24076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.823768 24076 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.824043 24076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a29a9c3dc574f048d3b8d10fd2e42fb, State: Initialized, Role: FOLLOWER
12:16:25.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.825094 24076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } }
12:16:25.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.828362 24284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.830492 24284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.835688 24076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: configured and running, proceeding with master startup.
12:16:25.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.836282 24049 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [term 0 FOLLOWER]: Advancing to term 1
12:16:25.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.839011 24050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50e1cedcc9914a6189ca82537a7556b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb"
12:16:25.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.841691 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "50e1cedcc9914a6189ca82537a7556b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" is_pre_election: true
12:16:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.850147 24049 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [term 1 FOLLOWER]: Refusing update from remote peer 50e1cedcc9914a6189ca82537a7556b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:25.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.853250 24272 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:25.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.856343 24266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50e1cedcc9914a6189ca82537a7556b8. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.857064 24266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.875555 24266 sys_catalog.cc:455] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.876567 24266 sys_catalog.cc:458] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587 [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.883015 24241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.883749 24241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: This master's current role is: LEADER
12:16:25.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.889505 24281 catalog_manager.cc:1383] Generated new cluster ID: a3ea02be8fce477cabef023e455a0e20
12:16:25.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.889799 24281 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:16:25.894 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:25.894 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:25.895 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:25.895 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.895 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.895 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:25.895 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.895 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.895 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:25.895 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.896 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.896 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:25.896 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:25.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.901208 24284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50e1cedcc9914a6189ca82537a7556b8. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.901940 24284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.904510 24272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.905185 24272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8 [sys.catalog]: This master's current role is: LEADER
12:16:25.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.927359 24284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "50e1cedcc9914a6189ca82537a7556b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a29a9c3dc574f048d3b8d10fd2e42fb" member_type: VOTER last_known_addr { host: "127.23.110.126" port: 40817 } } peers { permanent_uuid: "549876b8fda045de9e2733f54bfc6587" member_type: VOTER last_known_addr { host: "127.23.110.125" port: 35201 } } peers { permanent_uuid: "50e1cedcc9914a6189ca82537a7556b8" member_type: VOTER last_known_addr { host: "127.23.110.124" port: 37703 } } }
12:16:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.928058 24284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb [sys.catalog]: This master's current role is: FOLLOWER
12:16:25.946 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:25.946 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:25.946 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:25.946 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.946 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.946 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.946 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.946 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:25.946 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:25.947 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.947 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.947 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:25.947 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:25.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.947641 24281 catalog_manager.cc:1406] Generated new certificate authority record
12:16:25.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.949510 24281 catalog_manager.cc:1540] Loading token signing keys...
12:16:25.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.985384 24281 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 50e1cedcc9914a6189ca82537a7556b8: Generated new TSK 0
12:16:25.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:25.986507 24281 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.003141 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/logs
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data/info.pb
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:26.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.65:0
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.65
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.65
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:26.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:26.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 32 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512986002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:26.014 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 32 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=11 ms, finalizationTime=1 ms).
12:16:26.015 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 32 as completed for source Source: KuduSource.
12:16:26.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.037094 24303 catalog_manager.cc:1295] Loaded cluster ID: a3ea02be8fce477cabef023e455a0e20
12:16:26.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.037318 24303 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: loading cluster ID for follower catalog manager: success
12:16:26.042 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:26.042 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:26.042 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:26.042 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:26.042 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:26.042 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:26.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:26.043 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:26.043 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:26.043 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:26.043 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:26.043 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:26.043 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:26.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.071305 24303 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: acquiring CA information for follower catalog manager: success
12:16:26.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.090462 24303 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1a29a9c3dc574f048d3b8d10fd2e42fb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:16:26.105 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:26.105 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:26.105 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:26.105 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.105 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.105 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.106 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.106 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.106 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.106 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:26.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.415 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:26.415 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:26.415 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:26.416 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.416 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.416 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.416 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.416 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.416 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.416 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.416 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.416 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.417 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:26.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:26.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:26.434 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:26.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.435 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:26.435 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:26.435 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:26.435 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:26.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.499825 24305 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:26.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.500478 24305 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:26.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.501204 24305 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:26.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 33 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512986502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:26.513 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 33 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=10 ms, finalizationTime=1 ms).
12:16:26.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 33 as completed for source Source: KuduSource.
12:16:26.552 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.559391 24305 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:26.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.561321 24305 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.110.65
12:16:26.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.634344 24305 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:26.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:26.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:26.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.65:0
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data/info.pb
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.65
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.65
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/logs
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:26.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:26.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.637135 24305 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:26.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.639536 24305 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:26.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.657475 24311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:26.721 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:26.721 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:26.721 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:26.722 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:26.722 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:26.722 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:26.722 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:26.722 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:26.722 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:26.722 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:26.722 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:26.722 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:26.722 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:26.750 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:26.751 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:26.751 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:26.751 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.751 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.751 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.752 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.752 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.752 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.752 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.752 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.752 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:26.754 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.795 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:26.795 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:26.795 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:26.796 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:26.796 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:26.796 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:26.796 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:26.796 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:26.796 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:26.796 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:26.796 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:26.796 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:26.797 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:26.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.798930 24280 catalog_manager.cc:1295] Loaded cluster ID: a3ea02be8fce477cabef023e455a0e20
12:16:26.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.802585 24280 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: loading cluster ID for follower catalog manager: success
12:16:26.818 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.826548 24280 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: acquiring CA information for follower catalog manager: success
12:16:26.845 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:26.845 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:26.845 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:26.845 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.845 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.845 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:26.846 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.846 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.846 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:26.846 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.846 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.846 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:26.846 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:26.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:26.849032 24280 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 549876b8fda045de9e2733f54bfc6587: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:16:26.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:26.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:26.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:26.957 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:26.958 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:26.958 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:26.958 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:26.958 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:26.958 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:26.958 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:26.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:26.959 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:26.959 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:26.959 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:27.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 34 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512987002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:27.015 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 34 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:16:27.016 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 34 as completed for source Source: KuduSource.
12:16:27.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.318 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:27.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:27.450 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:27.451 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:27.451 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:27.451 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:27.451 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:27.451 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:27.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:27.451 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:27.451 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:27.451 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:27.451 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:27.493 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:27.493 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:27.493 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:27.494 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:27.494 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:27.494 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:27.494 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:27.494 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:27.494 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:27.494 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:27.494 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:27.494 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:27.494 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:27.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 35 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512987502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:27.507 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:27.507 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:27.507 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:27.507 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:27.507 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:27.508 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:27.508 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:27.508 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:27.508 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:27.507 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:27.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:27.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:27.508 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:27.516 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 35 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=14 ms, finalizationTime=0 ms).
12:16:27.518 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 35 as completed for source Source: KuduSource.
12:16:27.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.757 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:27.757 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:27.757 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:27.758 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:27.758 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:27.758 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:27.758 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:27.758 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:27.758 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:27.759 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:27.759 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:27.759 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:27.759 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:27.819 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:27.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:27.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:27.862 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:27.863 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:27.863 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:27.863 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:27.863 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:27.863 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:27.863 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:27.864 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:27.864 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:27.864 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:27.864 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:27.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 36 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512988002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:28.015 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 36 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:16:28.017 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 36 as completed for source Source: KuduSource.
12:16:28.053 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.074 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:28.074 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:28.074 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:28.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.074 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.074 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.075 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:28.094 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:28.094 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:28.095 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:28.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.095 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.095 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.096 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.096 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.096 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.096 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:28.152 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:28.152 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:28.152 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:28.152 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.152 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.152 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.153 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.153 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.153 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.153 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.153 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.153 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:28.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:28.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:28.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:28.275 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.275 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.275 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.275 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.275 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:28.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:28.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:28.275 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:28.319 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:28.057004 24310 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 24305
12:16:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:28.336766 24310 kernel_stack_watchdog.cc:198] Thread 24305 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 396ms:
12:16:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:16:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:16:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:16:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:16:28.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:26.659751 24312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:28.342301 24305 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.684s	user 0.679s	sys 0.848s
12:16:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:28.343211 24305 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.685s	user 0.679s	sys 0.848s
12:16:28.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.352923 24305 server_base.cc:1061] running on GCE node
12:16:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:28.354537 24318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:28.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.355978 24305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:28.361 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:28.361 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:28.361 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:28.362 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.362 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.362 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.362 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.362 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.362 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.362 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.362 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.362 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.362 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:28.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.371735 24305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:28.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.375455 24305 hybrid_clock.cc:648] HybridClock initialized: now 1783512988375373 us; error 82 us; skew 500 ppm
12:16:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.376601 24305 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:28.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.399374 24305 webserver.cc:533] Webserver started at http://127.23.110.65:44379/ using document root <none> and password file <none>
12:16:28.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.400760 24305 fs_manager.cc:362] Metadata directory not provided
12:16:28.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.401158 24305 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:28.402 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:28.402 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:28.402 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:28.402 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.402 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.402 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.402 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.402 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:28.402 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.402 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.401847 24305 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:28.402 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:28.402 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:28.403 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.408048 24305 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data/instance:
12:16:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2bf29054a41a4a2988efd660ec5f186f"
12:16:28.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:28 on dist-test-slave-vcgh"
12:16:28.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.409533 24305 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal/instance:
12:16:28.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2bf29054a41a4a2988efd660ec5f186f"
12:16:28.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:28 on dist-test-slave-vcgh"
12:16:28.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.425274 24305 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.005s	sys 0.009s
12:16:28.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.438261 24323 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:28.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.439494 24305 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.004s	sys 0.004s
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.439867 24305 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2bf29054a41a4a2988efd660ec5f186f"
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:28 on dist-test-slave-vcgh"
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.440279 24305 fs_report.cc:389] FS layout report
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:28.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data/data
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:28.466 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:28.466 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:28.466 [DEBUG - pool-362-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:28.467 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.467 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.467 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.467 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.467 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.467 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.468 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.468 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.468 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.468 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:28.469 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27757), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [12ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [12ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [33ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [34ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [65ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [164ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [963ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1420ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1422ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [4823ms] refreshing cache from master, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [4824ms] too many traces: truncated at 100 traces, deferred=Deferred@515474227(state=PENDING, result=null, callback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284), errback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284)))
12:16:28.469 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:16:28.470 [WARN - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27757), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [12ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [12ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [33ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [34ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [65ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [164ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [963ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1420ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1422ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [4823ms] refreshing cache from master, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [4824ms] too many traces: truncated at 100 traces, deferred=Deferred@515474227(state=PENDING, result=null, callback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284), errback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:28.470 [INFO - Source: KuduSource -> Sink: Writer (3/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1).
12:16:28.472 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#1 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
12:16:28.474 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1) switched from INITIALIZING to FAILED on 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=27757), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [12ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [12ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [33ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [34ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [43ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [65ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [164ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [164ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [963ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1420ms] refreshing cache from master, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1421ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1422ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1422ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [4823ms] refreshing cache from master, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [4824ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [4824ms] too many traces: truncated at 100 traces, deferred=Deferred@515474227(state=PENDING, result=null, callback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284), errback=(continuation of Deferred@2091725277 after retry RPC after error@1234373370) -> (continuation of Deferred@2027408011 after retry RPC after error@715488953) -> (continuation of Deferred@1058247145 after retry RPC after error@1854310443) -> (continuation of Deferred@683906274 after retry RPC after error@689072117) -> (continuation of Deferred@170731495 after retry RPC after error@1353720153) -> (continuation of Deferred@1684069161 after retry RPC after error@1593259423) -> (continuation of Deferred@1023812537 after retry RPC after error@1827501993) -> (continuation of Deferred@238440590 after retry RPC after error@1762314010) -> (continuation of Deferred@1696414313 after retry RPC after error@1649039708) -> (continuation of Deferred@1581565883 after retry RPC after error@1632237950) -> (continuation of Deferred@1829460300 after retry RPC after error@1572564232) -> (continuation of Deferred@624558107 after retry RPC after error@186032075) -> (continuation of Deferred@1021339356 after retry RPC after error@984981349) -> (continuation of Deferred@1341811440 after retry RPC after error@1890409475) -> (continuation of Deferred@1329857100 after retry RPC after error@1495069302) -> (continuation of Deferred@1169014351 after retry RPC after error@1610268605) -> (continuation of Deferred@818118764 after retry RPC after error@250760000) -> (continuation of Deferred@646300439 after retry RPC after error@738756397) -> (continuation of Deferred@14983712 after retry RPC after error@475021623) -> (continuation of Deferred@340108497 after retry RPC after error@2082236571) -> (continuation of Deferred@1506549914 after retry RPC after error@1191943021) -> (continuation of Deferred@2127682673 after retry RPC after error@1637231488) -> (continuation of Deferred@1508249560 after retry RPC after error@1110255482) -> (continuation of Deferred@846154010 after retry RPC after error@1660268284)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:28.475 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_1.
12:16:28.476 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state RUNNING to RESTARTING.
12:16:28.476 [WARN - flink-pekko.actor.default-dispatcher-7] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:16:28.476 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:28.477 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#1) of source Source: KuduSource.
12:16:28.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 37 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512988502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:28.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 37 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:28.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 37 as completed for source Source: KuduSource.
12:16:28.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.535230 24305 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:28.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.537248 24305 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:28.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.537786 24305 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:28.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.547827 24305 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:28.553 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.559350 24305 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:28.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.559628 24305 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:28.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.559900 24305 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:28.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.560092 24305 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:28.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:28.614 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:28.615 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:28.615 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.615 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.615 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:28.615 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:28.616 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.616 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.616 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:28.616 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:28.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.770 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:28.771 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:28.771 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:28.771 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.771 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.771 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.772 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.772 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.772 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.772 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.772 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.772 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.772 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:28.869 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:28.870 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:28.870 [DEBUG - pool-358-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:28.870 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.870 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:28.870 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.871 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.871 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:28.871 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.871 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.871 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:28.871 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:28.872 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28191), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [15ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [37ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [37ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [52ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [60ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [61ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [91ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [92ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [94ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [94ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [222ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [302ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [982ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [984ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [985ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [985ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [2082ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3000ms] refreshing cache from master, [3000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3001ms] too many traces: truncated at 100 traces, deferred=Deferred@1174981871(state=PENDING, result=null, callback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521), errback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521)))
12:16:28.872 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:16:28.873 [WARN - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28191), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [15ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [37ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [37ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [52ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [60ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [61ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [91ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [92ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [94ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [94ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [222ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [302ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [982ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [984ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [985ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [985ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [2082ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3000ms] refreshing cache from master, [3000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3001ms] too many traces: truncated at 100 traces, deferred=Deferred@1174981871(state=PENDING, result=null, callback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521), errback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:28.873 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
12:16:28.875 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#1 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:16:28.877 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28191), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [15ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [24ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [37ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [37ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [52ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [60ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [61ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [90ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [91ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [92ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [94ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [94ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [222ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [302ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [982ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [984ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [985ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [985ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2081ms] refreshing cache from master, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2082ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [2082ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3000ms] refreshing cache from master, [3000ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3001ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3001ms] too many traces: truncated at 100 traces, deferred=Deferred@1174981871(state=PENDING, result=null, callback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521), errback=(continuation of Deferred@257515716 after retry RPC after error@1950329952) -> (continuation of Deferred@740478193 after retry RPC after error@743248430) -> (continuation of Deferred@1750468643 after retry RPC after error@1627649509) -> (continuation of Deferred@1534916720 after retry RPC after error@535055699) -> (continuation of Deferred@1194019228 after retry RPC after error@972628033) -> (continuation of Deferred@100331638 after retry RPC after error@944352079) -> (continuation of Deferred@632513139 after retry RPC after error@1429775788) -> (continuation of Deferred@127108669 after retry RPC after error@1928676947) -> (continuation of Deferred@1282085508 after retry RPC after error@1550764896) -> (continuation of Deferred@1196887230 after retry RPC after error@524815833) -> (continuation of Deferred@195281798 after retry RPC after error@565984345) -> (continuation of Deferred@1592915500 after retry RPC after error@25698030) -> (continuation of Deferred@337793706 after retry RPC after error@1421671043) -> (continuation of Deferred@86849198 after retry RPC after error@1142105995) -> (continuation of Deferred@1117952673 after retry RPC after error@1912150164) -> (continuation of Deferred@487442499 after retry RPC after error@1090493206) -> (continuation of Deferred@383673914 after retry RPC after error@794489293) -> (continuation of Deferred@1550216117 after retry RPC after error@1618832388) -> (continuation of Deferred@100088199 after retry RPC after error@2111534189) -> (continuation of Deferred@311399328 after retry RPC after error@421122233) -> (continuation of Deferred@631171356 after retry RPC after error@62953950) -> (continuation of Deferred@1832650901 after retry RPC after error@980910483) -> (continuation of Deferred@1760774600 after retry RPC after error@1870279521)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:28.878 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#1) of source Source: KuduSource.
12:16:28.878 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
12:16:28.878 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:28.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.885617 24305 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.65:42335
12:16:28.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.885732 24436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.65:42335 every 8 connection(s)
12:16:28.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.888448 24305 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/data/info.pb
12:16:28.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.897318 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24305
12:16:28.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.897998 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-0/wal/instance
12:16:28.922 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RESTARTING to RUNNING.
12:16:28.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:28.923 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 6b98bc975be284725b662aff85b5faa8 from Checkpoint 68 @ 1783512790749 for 6b98bc975be284725b662aff85b5faa8 located at file:/tmp/junit7211770355409449179/checkpoints/6b98bc975be284725b662aff85b5faa8/chk-68.
12:16:28.923 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:16:28.923 [INFO - flink-pekko.actor.default-dispatcher-7] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:28.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:28.927287 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:28.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:28.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/logs
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data/info.pb
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.66:0
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.66
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.66
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:28.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:28.933 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
12:16:28.933 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:28.933 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
12:16:28.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 154b74b5f9dbb0c714a11fccfe184c75
12:16:28.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
12:16:28.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
12:16:28.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id dbd00510a04dbb00458d20e911a1c6ac
12:16:28.934 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to SCHEDULED.
12:16:28.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from SCHEDULED to DEPLOYING.
12:16:28.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #7) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id 51eedb814078aca1d10de66e4d8aafa4
12:16:28.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
12:16:28.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
12:16:28.935 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1) with allocation id f6cd9ce344feec383d8c503432ef47a2
12:16:28.936 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:28.937 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 154b74b5f9dbb0c714a11fccfe184c75.
12:16:28.938 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 154b74b5f9dbb0c714a11fccfe184c75.
12:16:28.940 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:28.942 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:28.942 [INFO - Thread-65] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:28.942 [DEBUG - Thread-65] (Connection.java:575) [peer master-127.11.38.60:33275(127.11.38.60:33275)] disconnecting while in state TERMINATED
12:16:28.943 [DEBUG - Thread-65] (Connection.java:575) [peer master-127.11.38.61:36393(127.11.38.61:36393)] disconnecting while in state TERMINATED
12:16:28.943 [DEBUG - Thread-65] (Connection.java:575) [peer master-127.11.38.62:34839(127.11.38.62:34839)] disconnecting while in state TERMINATED
12:16:28.943 [DEBUG - Thread-65] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:28.944 [INFO - Thread-65] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:28.945 [INFO - Thread-65] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:28.946 [DEBUG - Thread-65] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:28.946 [INFO - Thread-65] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:28.947 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot dbd00510a04dbb00458d20e911a1c6ac.
12:16:28.947 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id dbd00510a04dbb00458d20e911a1c6ac.
12:16:28.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
12:16:28.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
12:16:28.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6dbc552
12:16:28.948 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:28.949 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:16:28.949 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
12:16:28.949 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
12:16:28.953 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:28.953 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:28.953 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:28.954 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.954 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.954 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:28.954 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.954 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.954 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:28.955 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.955 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.955 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:28.955 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:28.958 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot 51eedb814078aca1d10de66e4d8aafa4.
12:16:28.959 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
12:16:28.959 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
12:16:28.959 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@17d35a77
12:16:28.959 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:28.960 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:16:28.960 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7), deploy into slot with allocation id 51eedb814078aca1d10de66e4d8aafa4.
12:16:28.961 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5a3c9070
12:16:28.965 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
12:16:28.965 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
12:16:28.971 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:28.977 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e10c052
12:16:28.989 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:28.998 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:28.998 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:28.998 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:28.998 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:28.999 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskSlotTableImpl.java:391) Activate slot f6cd9ce344feec383d8c503432ef47a2.
12:16:29.000 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id f6cd9ce344feec383d8c503432ef47a2.
12:16:29.000 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from CREATED to DEPLOYING.
12:16:29.000 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) [DEPLOYING].
12:16:29.001 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f169adf
12:16:29.001 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:29.001 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:16:29.001 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
12:16:29.001 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from DEPLOYING to INITIALIZING.
12:16:29.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 38 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512989002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:29.004 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
12:16:29.004 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
12:16:29.009 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5edf8a6d
12:16:29.009 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:29.010 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit7211770355409449179/checkpoints")
12:16:29.010 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
12:16:29.010 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
12:16:29.011 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 38 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:29.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 38 as completed for source Source: KuduSource.
12:16:29.012 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@306305c1
12:16:29.014 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:29.019 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@78bfd18b
12:16:29.021 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.021 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:29.049 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.052 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.052 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.053 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.053 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.053 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.067 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.067 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.067 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.068 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.077 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:29.078 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.078 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:29.078 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:29.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:29.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:29.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:29.078 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:29.079 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:29.079 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:29.079 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:29.079 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:29.079 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:29.079 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:29.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.079 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.093 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.102 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.103120 24437 heartbeater.cc:344] Connected to a master server at 127.23.110.124:37703
12:16:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.103441 24438 heartbeater.cc:344] Connected to a master server at 127.23.110.125:35201
12:16:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.103662 24437 heartbeater.cc:461] Registering TS with master...
12:16:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.103904 24438 heartbeater.cc:461] Registering TS with master...
12:16:29.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.105324 24438 heartbeater.cc:507] Master 127.23.110.125:35201 requested a full tablet report, sending...
12:16:29.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.107401 24444 heartbeater.cc:344] Connected to a master server at 127.23.110.126:40817
12:16:29.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.107735 24444 heartbeater.cc:461] Registering TS with master...
12:16:29.110 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.108613 24444 heartbeater.cc:507] Master 127.23.110.126:40817 requested a full tablet report, sending...
12:16:29.111 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.109824 24117 ts_manager.cc:194] Registered new tserver with Master: 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335)
12:16:29.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.110620 24437 heartbeater.cc:507] Master 127.23.110.124:37703 requested a full tablet report, sending...
12:16:29.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.111959 24041 ts_manager.cc:194] Registered new tserver with Master: 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335)
12:16:29.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.113116 24197 ts_manager.cc:194] Registered new tserver with Master: 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335)
12:16:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.115630 24197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.110.65:52875
12:16:29.117 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.117 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.118 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.118 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.125 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.125 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.130 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.134 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.135 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.135 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.135 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.136 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.136 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.136 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.136 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.137 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#7] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.137 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.137 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.138 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.138 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.138 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.138 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.138 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.139 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.139 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.139 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.139 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.139 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.140 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.140 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.140 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.140 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.140 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.140 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.141 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.141 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.141 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.141 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.141 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.142 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.142 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.142 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.142 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.142 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.143 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.143 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.143 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.144 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.144 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.144 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.144 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.145 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.145 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.145 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.145 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.146 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.147 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.147 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.147 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.147 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.148 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.148 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.148 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.150 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.150 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.150 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.150 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.150 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.150 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.151 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.151 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.151 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.151 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.151 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.151 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.151 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.151 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.151 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.151 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.152 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.152 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.153 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.154 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.155 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.162 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.163 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.163 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.166 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.166 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.166 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.167 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.167 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.167 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.167 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.168 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.169 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.170 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.170 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.170 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.170 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.170 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.170 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.170 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.171 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.171 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.171 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.171 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.171 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.172 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.172 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.172 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.172 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.172 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.172 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.172 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.173 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.173 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.173 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.173 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.173 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.174 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.174 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.174 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.174 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.174 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.175 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.175 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.175 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.176 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.176 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.176 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.176 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.176 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.177 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.177 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.177 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.178 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.178 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.178 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.178 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.178 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.178 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.179 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.179 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.181 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.181 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.181 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.182 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.182 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.182 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.182 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.182 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.182 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.183 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.184 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.184 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.184 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.184 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.184 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.184 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.184 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.185 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.185 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.185 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.185 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.186 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.186 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.186 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.186 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.186 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.186 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.186 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.190 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.190 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.190 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.191 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.193 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.193 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.193 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.193 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.193 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.194 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.194 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.194 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.194 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.194 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.194 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.194 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.201 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.201 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.202 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.202 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.202 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.202 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.202 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.202 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.202 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.203 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.203 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.203 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.203 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.203 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.203 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.203 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.203 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.203 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.203 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.204 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.204 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.204 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.205 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.205 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.205 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.205 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.205 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.205 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.209 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.209 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.209 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.210 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.210 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.210 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.210 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.210 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.210 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.210 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.210 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.213 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.214 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.214 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.215 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.215 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.215 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.222 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.223 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.223 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.223 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.223 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.223 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.223 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.223 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.223 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.224 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.224 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.224 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.224 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.230 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.230 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.230 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.230 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.230 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.230 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.230 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.230 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.230 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.230 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.230 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.231 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.231 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.242 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.243 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.243 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.243 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.243 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.243 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.243 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.243 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.243 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.244 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.244 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.244 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.244 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.244 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.244 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.244 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.244 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.245 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.245 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.245 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.245 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.245 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.245 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.245 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.245 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.246 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.246 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.246 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.246 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.246 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.246 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.246 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.246 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.246 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.246 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.247 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.247 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.247 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.247 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.254 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.254 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.254 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.255 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.255 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.255 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.255 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.255 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.255 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.255 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.259 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.261 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.262 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.262 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.262 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.262 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.262 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.262 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.262 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.262 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.262 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.262 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.262 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.262 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.274 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:29.274 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:29.274 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:29.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:29.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:29.275 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:29.275 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:29.275 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:29.275 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:29.276 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:29.276 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:29.276 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:29.276 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:29.283 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.283 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.283 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.283 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.283 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.284 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.284 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.284 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.284 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.284 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.284 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.284 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.284 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.324 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.324 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.324 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.325 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.325 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.325 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.325 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.326 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.326 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.326 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.326 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.326 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.326 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.327 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.328 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.328 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.328 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.328 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.329 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.330 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.330 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.330 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.330 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.330 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.331 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.331 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.333 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.333 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.333 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.334 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.334 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.334 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.341 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.341 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.341 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.342 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.342 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.342 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.342 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.342 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.342 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.342 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.342 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.342 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.342 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.344 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.344 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.344 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.345 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.345 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.345 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.345 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.345 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.345 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.345 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:29.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:29.395 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:29.395 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.395 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.396 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.396 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.396 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.396 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.396 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.396 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:29.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.408244 24443 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:29.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.408802 24443 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:29.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.409428 24443 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:29.414 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:29.414 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:29.414 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:29.414 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.415 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.415 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.415 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.415 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.415 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.415 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:29.423 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.423 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.423 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.424 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.424 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.424 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.424 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.424 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.424 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.424 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.448561 24443 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:29.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.449621 24443 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.110.66
12:16:29.454 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:29.454 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:29.454 [DEBUG - pool-370-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:29.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.454 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.455 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.455 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.455 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.455 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.455 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.455 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.455 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:29.456 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27087), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [4ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [32ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [44ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [263ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [324ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [324ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [744ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [882ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [903ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [903ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3683ms] refreshing cache from master, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3684ms] too many traces: truncated at 100 traces, deferred=Deferred@895939286(state=PENDING, result=null, callback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973), errback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973)))
12:16:29.457 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.457 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.457 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.457 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.457 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.458 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.458 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.458 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.458 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.459 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:16:29.459 [WARN - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27087), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [4ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [32ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [44ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [263ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [324ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [324ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [744ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [882ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [903ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [903ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3683ms] refreshing cache from master, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3684ms] too many traces: truncated at 100 traces, deferred=Deferred@895939286(state=PENDING, result=null, callback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973), errback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.459 [INFO - Source: KuduSource -> Sink: Writer (2/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4).
12:16:29.465 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#4 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:16:29.467 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=27087), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [4ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [29ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [32ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [44ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [121ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [122ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [122ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [141ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [144ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [262ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [263ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [263ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [324ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [324ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [742ms] refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [743ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [744ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [744ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [880ms] refreshing cache from master, [880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [882ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [882ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [902ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [903ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [903ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3683ms] refreshing cache from master, [3683ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3684ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3684ms] too many traces: truncated at 100 traces, deferred=Deferred@895939286(state=PENDING, result=null, callback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973), errback=(continuation of Deferred@1058008893 after retry RPC after error@1699721892) -> (continuation of Deferred@1622353458 after retry RPC after error@1656854704) -> (continuation of Deferred@578287058 after retry RPC after error@976599466) -> (continuation of Deferred@1129224808 after retry RPC after error@765759145) -> (continuation of Deferred@819996586 after retry RPC after error@655306997) -> (continuation of Deferred@279278502 after retry RPC after error@436037341) -> (continuation of Deferred@672259903 after retry RPC after error@1992809040) -> (continuation of Deferred@1304739693 after retry RPC after error@1065214854) -> (continuation of Deferred@431176561 after retry RPC after error@1366189901) -> (continuation of Deferred@968459738 after retry RPC after error@1770528952) -> (continuation of Deferred@1776346699 after retry RPC after error@1268162613) -> (continuation of Deferred@1047821256 after retry RPC after error@374407518) -> (continuation of Deferred@2020437857 after retry RPC after error@109375313) -> (continuation of Deferred@456355442 after retry RPC after error@100063163) -> (continuation of Deferred@376677891 after retry RPC after error@925642235) -> (continuation of Deferred@929863058 after retry RPC after error@76863435) -> (continuation of Deferred@266091236 after retry RPC after error@1506385169) -> (continuation of Deferred@173687743 after retry RPC after error@676526000) -> (continuation of Deferred@1178071876 after retry RPC after error@1401151366) -> (continuation of Deferred@194783730 after retry RPC after error@877441094) -> (continuation of Deferred@1301858392 after retry RPC after error@11161986) -> (continuation of Deferred@1788034012 after retry RPC after error@990668872) -> (continuation of Deferred@811445625 after retry RPC after error@1646906545) -> (continuation of Deferred@286742259 after retry RPC after error@1233203889) -> (continuation of Deferred@342522013 after retry RPC after error@940208869) -> (continuation of Deferred@318839769 after retry RPC after error@1406511026) -> (continuation of Deferred@339514309 after retry RPC after error@2143966973)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.468 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:29.471 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#4) of source Source: KuduSource.
12:16:29.472 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_4.
12:16:29.472 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RUNNING to RESTARTING.
12:16:29.483 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.483 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.483 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.483 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.483 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.484 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.484 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.484 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.484 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.484 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.484 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.501 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.501 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.502 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.502 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.502 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 39 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512989502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:29.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.503 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.503 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.503 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.503 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.510 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.511 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.511 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.513 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.513 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.513 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.510893 24443 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.66:0
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data/info.pb
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.66
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:29.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.66
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/logs
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:29.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.512629 24443 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:29.514 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.514 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.514 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.515 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.515 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:29.514780 24443 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:29.519 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 39 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=16 ms, finalizationTime=1 ms).
12:16:29.521 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 39 as completed for source Source: KuduSource.
12:16:29.521 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.522 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.522 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.522 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.522 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.522 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.522 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.522 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.522 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.523 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.523 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.523 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.523 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.530573 24507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:29.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:29.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:29.555 [DEBUG - pool-374-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:29.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.556 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.556 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.556 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.556 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.556 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.556 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.556 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.557 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:29.557 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27183), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [342ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [342ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [543ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [543ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1323ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1921ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1922ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@885382685(state=PENDING, result=null, callback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917), errback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917)))
12:16:29.558 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:16:29.559 [WARN - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27183), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [342ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [342ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [543ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [543ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1323ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1921ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1922ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@885382685(state=PENDING, result=null, callback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917), errback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.188:40073
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.559 [INFO - Source: KuduSource -> Sink: Writer (4/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4).
12:16:29.562 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.563 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.563 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.563 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.563 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.563 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.563 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.563 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.563 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.564 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.564 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.564 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.564 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:29.564 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#4 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:16:29.566 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=27183), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [9ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [35ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [37ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [49ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [50ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [63ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [102ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [181ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [182ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [182ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [221ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [341ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [342ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [342ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [542ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [543ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [543ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1322ms] refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1322ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1323ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1921ms] refreshing cache from master, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1922ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1922ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [5681ms] refreshing cache from master, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [5681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [5682ms] too many traces: truncated at 100 traces, deferred=Deferred@885382685(state=PENDING, result=null, callback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917), errback=(continuation of Deferred@1512154805 after retry RPC after error@1614595508) -> (continuation of Deferred@502855416 after retry RPC after error@131593836) -> (continuation of Deferred@1343548461 after retry RPC after error@1443070718) -> (continuation of Deferred@211214832 after retry RPC after error@877269656) -> (continuation of Deferred@1128854968 after retry RPC after error@160861021) -> (continuation of Deferred@850686718 after retry RPC after error@1452173538) -> (continuation of Deferred@1391440574 after retry RPC after error@1872627677) -> (continuation of Deferred@2125245266 after retry RPC after error@1530926365) -> (continuation of Deferred@1955931785 after retry RPC after error@1806333737) -> (continuation of Deferred@1883748149 after retry RPC after error@737455325) -> (continuation of Deferred@1980261956 after retry RPC after error@1310934163) -> (continuation of Deferred@59812989 after retry RPC after error@227310230) -> (continuation of Deferred@948115237 after retry RPC after error@1825627002) -> (continuation of Deferred@1789227481 after retry RPC after error@68415185) -> (continuation of Deferred@613022537 after retry RPC after error@1323892649) -> (continuation of Deferred@260203540 after retry RPC after error@352085587) -> (continuation of Deferred@2143585334 after retry RPC after error@1993877968) -> (continuation of Deferred@1785086427 after retry RPC after error@492796986) -> (continuation of Deferred@1189199507 after retry RPC after error@1908447542) -> (continuation of Deferred@703620684 after retry RPC after error@1328050660) -> (continuation of Deferred@83250100 after retry RPC after error@1904900917)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.188:40073
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.568 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:29.569 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#4) of source Source: KuduSource.
12:16:29.569 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_4.
12:16:29.573 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.573 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.573 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.573 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.573 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.573 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.574 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:29.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:29.590 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:29.591 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:29.591 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:29.591 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:29.591 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:29.591 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:29.591 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:29.591 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:29.591 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:29.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:29.591 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:29.609 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:29.609 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:29.609 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:29.609 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:29.609 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:29.609 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:29.610 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:29.610 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:29.610 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:29.610 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:29.610 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:29.610 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:29.610 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:29.655 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:29.655 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:29.655 [DEBUG - pool-364-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:29.655 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.655 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.656 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.656 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.656 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.656 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.656 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.656 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.656 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.656 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:29.657 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28932), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [14ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [20ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [21ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [44ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [71ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [242ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [642ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1681ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1021181106(state=PENDING, result=null, callback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752), errback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752)))
12:16:29.658 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:16:29.658 [WARN - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28932), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [14ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [20ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [21ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [44ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [71ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [242ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [642ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1681ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1021181106(state=PENDING, result=null, callback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752), errback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.658 [INFO - Source: KuduSource -> Sink: Writer (4/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1).
12:16:29.660 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#1 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:16:29.662 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1) switched from INITIALIZING to FAILED on 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28932), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [14ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [20ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [21ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [21ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [44ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [44ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [71ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [81ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [242ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [641ms] refreshing cache from master, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [642ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [642ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1681ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3021ms] refreshing cache from master, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [3021ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3022ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [6700ms] refreshing cache from master, [6700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [6701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [6701ms] too many traces: truncated at 100 traces, deferred=Deferred@1021181106(state=PENDING, result=null, callback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752), errback=(continuation of Deferred@873405741 after retry RPC after error@826867295) -> (continuation of Deferred@669085702 after retry RPC after error@1946824740) -> (continuation of Deferred@950054397 after retry RPC after error@1315706544) -> (continuation of Deferred@1654734395 after retry RPC after error@1192212827) -> (continuation of Deferred@2063411970 after retry RPC after error@1409973115) -> (continuation of Deferred@1068619559 after retry RPC after error@97416427) -> (continuation of Deferred@377027179 after retry RPC after error@288266876) -> (continuation of Deferred@546799505 after retry RPC after error@1443376708) -> (continuation of Deferred@133311820 after retry RPC after error@1651157684) -> (continuation of Deferred@2031762079 after retry RPC after error@1853309430) -> (continuation of Deferred@2021235001 after retry RPC after error@1332851592) -> (continuation of Deferred@1729603131 after retry RPC after error@867902430) -> (continuation of Deferred@121623745 after retry RPC after error@1167120989) -> (continuation of Deferred@527211178 after retry RPC after error@1973677898) -> (continuation of Deferred@205759715 after retry RPC after error@1329779972) -> (continuation of Deferred@880848780 after retry RPC after error@1580453865) -> (continuation of Deferred@1329994864 after retry RPC after error@385157737) -> (continuation of Deferred@657996788 after retry RPC after error@1739912317) -> (continuation of Deferred@409915751 after retry RPC after error@645277249) -> (continuation of Deferred@1081564896 after retry RPC after error@2117007) -> (continuation of Deferred@1848332549 after retry RPC after error@2046310063) -> (continuation of Deferred@50525998 after retry RPC after error@30187252) -> (continuation of Deferred@895173809 after retry RPC after error@221135355) -> (continuation of Deferred@419527927 after retry RPC after error@2086627869) -> (continuation of Deferred@332318699 after retry RPC after error@1821408752)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.223.254:42193
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:29.663 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:29.665 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#1) of source Source: KuduSource.
12:16:29.666 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_1.
12:16:29.713 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:29.713 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:29.713 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:29.714 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.714 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.714 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:29.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.714 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:29.715 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.715 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.715 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:29.715 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:29.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.754 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:29.754 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:29.754 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:29.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:29.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:29.755 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.755 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.755 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:29.755 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:29.771 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:29.771 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:29.771 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:29.772 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.772 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.772 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:29.772 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.772 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.772 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:29.772 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.772 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.772 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:29.772 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:29.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:29.963 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:29.963 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:29.963 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:29.964 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.964 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.964 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:29.964 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.964 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.964 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:29.964 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.964 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.964 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:29.964 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 40 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512990001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:30.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.002 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.003 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.003 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.003 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.003 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.003 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.003 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.003 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.003 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.003 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.004 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.009 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.010 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.010 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.010 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.010 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.010 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.011 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.011 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.011 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.011 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.015 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 40 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=13 ms, finalizationTime=1 ms).
12:16:30.016 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 40 as completed for source Source: KuduSource.
12:16:30.017 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.018 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.018 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.018 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.019 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.019 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.019 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.019 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.019 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.020 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29286), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [9ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [11ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [41ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [143ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [542ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1022ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2921ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2922ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3261ms] too many traces: truncated at 100 traces, deferred=Deferred@2023831236(state=PENDING, result=null, callback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838), errback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838)))
12:16:30.020 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.020 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.020 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.021 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29286), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [9ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [11ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [41ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [143ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [542ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1022ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2921ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2922ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3261ms] too many traces: truncated at 100 traces, deferred=Deferred@2023831236(state=PENDING, result=null, callback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838), errback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29286), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [9ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [11ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [41ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [143ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [542ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1022ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2921ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2922ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3261ms] too many traces: truncated at 100 traces, deferred=Deferred@2023831236(state=PENDING, result=null, callback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838), errback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.126:41267
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:30.022 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.022 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.022 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.022 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.022 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.022 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.022 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.022 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.022 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.022 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.027 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29286), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [9ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [11ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [41ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [143ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [542ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1022ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2921ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2922ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3261ms] too many traces: truncated at 100 traces, deferred=Deferred@2023831236(state=PENDING, result=null, callback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838), errback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29286), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [9ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [10ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [11ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [11ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [25ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [41ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [45ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [70ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [73ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [74ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [74ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [82ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [82ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [102ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [143ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [542ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [781ms] refreshing cache from master, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [782ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1022ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2920ms] refreshing cache from master, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2921ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2921ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2922ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2922ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3260ms] refreshing cache from master, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3261ms] too many traces: truncated at 100 traces, deferred=Deferred@2023831236(state=PENDING, result=null, callback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838), errback=(continuation of Deferred@652802176 after retry RPC after error@1992328390) -> (continuation of Deferred@553332134 after retry RPC after error@1369253995) -> (continuation of Deferred@819000864 after retry RPC after error@1111794248) -> (continuation of Deferred@992682427 after retry RPC after error@55417029) -> (continuation of Deferred@882577274 after retry RPC after error@1403694403) -> (continuation of Deferred@829319284 after retry RPC after error@1586124076) -> (continuation of Deferred@839278936 after retry RPC after error@876614382) -> (continuation of Deferred@1982849498 after retry RPC after error@2046880006) -> (continuation of Deferred@2064473023 after retry RPC after error@1332670802) -> (continuation of Deferred@1187440724 after retry RPC after error@997417299) -> (continuation of Deferred@707925281 after retry RPC after error@317621588) -> (continuation of Deferred@1671125781 after retry RPC after error@1128454092) -> (continuation of Deferred@2044938648 after retry RPC after error@532789205) -> (continuation of Deferred@641402059 after retry RPC after error@1930582903) -> (continuation of Deferred@274625284 after retry RPC after error@36897221) -> (continuation of Deferred@2085638164 after retry RPC after error@494429450) -> (continuation of Deferred@2128475122 after retry RPC after error@1694165189) -> (continuation of Deferred@441763006 after retry RPC after error@1155179211) -> (continuation of Deferred@1426693057 after retry RPC after error@1711730021) -> (continuation of Deferred@1523299375 after retry RPC after error@1259768135) -> (continuation of Deferred@1389937783 after retry RPC after error@56911500) -> (continuation of Deferred@67751939 after retry RPC after error@2074750324) -> (continuation of Deferred@1875223818 after retry RPC after error@1328934520) -> (continuation of Deferred@91661909 after retry RPC after error@798882306) -> (continuation of Deferred@1840445198 after retry RPC after error@219452142) -> (continuation of Deferred@1029753111 after retry RPC after error@2104326483) -> (continuation of Deferred@127789943 after retry RPC after error@775391880) -> (continuation of Deferred@363124264 after retry RPC after error@60129838)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.126:41267
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:30.027 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:30.027 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#1) of source Source: KuduSource.
12:16:30.028 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:16:30.029 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:16:30.029 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from INITIALIZING to CANCELING.
12:16:30.029 [INFO - flink-pekko.actor.default-dispatcher-8] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:16:30.031 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.031 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.031 [DEBUG - pool-360-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.031 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.032 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.032 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.032 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.032 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.032 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.032 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.032 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.032 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.032 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.033 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29345), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [16ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [45ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [46ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [46ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [63ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [63ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [64ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [65ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [98ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [99ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [101ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [122ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [122ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [200ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [200ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [201ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [301ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [301ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [302ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [302ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [501ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [501ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [501ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [502ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [983ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [983ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [983ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [985ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [985ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1202ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1480ms] refreshing cache from master, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1481ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1481ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2401ms] refreshing cache from master, [2401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2402ms] too many traces: truncated at 100 traces, deferred=Deferred@2054260690(state=PENDING, result=null, callback=(continuation of Deferred@1978115148 after retry RPC after error@1946718402) -> (continuation of Deferred@1413114516 after retry RPC after error@570632406) -> (continuation of Deferred@1787706654 after retry RPC after error@1521495565) -> (continuation of Deferred@1574535429 after retry RPC after error@1713854448) -> (continuation of Deferred@2111496423 after retry RPC after error@650209559) -> (continuation of Deferred@931202403 after retry RPC after error@1808092340) -> (continuation of Deferred@1102206195 after retry RPC after error@1821770755) -> (continuation of Deferred@1392750319 after retry RPC after error@308476119) -> (continuation of Deferred@1101276068 after retry RPC after error@491688335) -> (continuation of Deferred@1408507935 after retry RPC after error@1448464118) -> (continuation of Deferred@906788507 after retry RPC after error@1596408636) -> (continuation of Deferred@757163039 after retry RPC after error@1442524467) -> (continuation of Deferred@14055857 after retry RPC after error@1703801908) -> (continuation of Deferred@1126855942 after retry RPC after error@1328831205) -> (continuation of Deferred@2082253123 after retry RPC after error@1991954080) -> (continuation of Deferred@1713899316 after retry RPC after error@195467878) -> (continuation of Deferred@317291744 after retry RPC after error@847675347) -> (continuation of Deferred@347201296 after retry RPC after error@737874506) -> (continuation of Deferred@1923904937 after retry RPC after error@1935013064) -> (continuation of Deferred@1762061549 after retry RPC after error@438094533) -> (continuation of Deferred@193787154 after retry RPC after error@1470341919) -> (continuation of Deferred@161238146 after retry RPC after error@1965745558) -> (continuation of Deferred@434289220 after retry RPC after error@1393776956) -> (continuation of Deferred@939587456 after retry RPC after error@447001411) -> (continuation of Deferred@379067081 after retry RPC after error@1602976671) -> (continuation of Deferred@1619536665 after retry RPC after error@1602859744) -> (continuation of Deferred@152151434 after retry RPC after error@230842548) -> (continuation of Deferred@741561078 after retry RPC after error@1044380450), errback=(continuation of Deferred@1978115148 after retry RPC after error@1946718402) -> (continuation of Deferred@1413114516 after retry RPC after error@570632406) -> (continuation of Deferred@1787706654 after retry RPC after error@1521495565) -> (continuation of Deferred@1574535429 after retry RPC after error@1713854448) -> (continuation of Deferred@2111496423 after retry RPC after error@650209559) -> (continuation of Deferred@931202403 after retry RPC after error@1808092340) -> (continuation of Deferred@1102206195 after retry RPC after error@1821770755) -> (continuation of Deferred@1392750319 after retry RPC after error@308476119) -> (continuation of Deferred@1101276068 after retry RPC after error@491688335) -> (continuation of Deferred@1408507935 after retry RPC after error@1448464118) -> (continuation of Deferred@906788507 after retry RPC after error@1596408636) -> (continuation of Deferred@757163039 after retry RPC after error@1442524467) -> (continuation of Deferred@14055857 after retry RPC after error@1703801908) -> (continuation of Deferred@1126855942 after retry RPC after error@1328831205) -> (continuation of Deferred@2082253123 after retry RPC after error@1991954080) -> (continuation of Deferred@1713899316 after retry RPC after error@195467878) -> (continuation of Deferred@317291744 after retry RPC after error@847675347) -> (continuation of Deferred@347201296 after retry RPC after error@737874506) -> (continuation of Deferred@1923904937 after retry RPC after error@1935013064) -> (continuation of Deferred@1762061549 after retry RPC after error@438094533) -> (continuation of Deferred@193787154 after retry RPC after error@1470341919) -> (continuation of Deferred@161238146 after retry RPC after error@1965745558) -> (continuation of Deferred@434289220 after retry RPC after error@1393776956) -> (continuation of Deferred@939587456 after retry RPC after error@447001411) -> (continuation of Deferred@379067081 after retry RPC after error@1602976671) -> (continuation of Deferred@1619536665 after retry RPC after error@1602859744) -> (continuation of Deferred@152151434 after retry RPC after error@230842548) -> (continuation of Deferred@741561078 after retry RPC after error@1044380450)))
12:16:30.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (SourceReaderBase.java:338) Closing Source Reader.
12:16:30.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:16:30.034 [INFO - Source: KuduSource -> Sink: Writer (2/4)#1] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#1 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1).
12:16:30.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.037 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.037 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.037 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.037 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.037 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.037 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.037 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.038 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.038 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.038 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.038 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.042 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.043 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.043 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.043 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.043 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.043 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.043 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.043 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.043 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.043 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#1 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1.
12:16:30.044 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.044 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.044 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_1) switched from CANCELING to CANCELED.
12:16:30.045 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 5273b45840e0da6e6ca30141a2a11dd8
12:16:30.057 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.057 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.057 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.058 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.059 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.059 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.059 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.059 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.077 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.077 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.077 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.077 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.077 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.077 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.077 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.077 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.077 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.078 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.078 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.078 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.078 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.097 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.097 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.098 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.098 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.098 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.098 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.098 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.098 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.098 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.099 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.099 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.099 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.099 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.109 [INFO - flink-pekko.actor.default-dispatcher-5] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state RESTARTING to RUNNING.
12:16:30.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:30.119220 24437 heartbeater.cc:499] Master 127.23.110.124:37703 was elected leader, sending a full tablet report...
12:16:30.126 [INFO - flink-pekko.actor.default-dispatcher-5] (CheckpointCoordinator.java:1805) Restoring job 5273b45840e0da6e6ca30141a2a11dd8 from Checkpoint 65 @ 1783512959162 for 5273b45840e0da6e6ca30141a2a11dd8 located at file:/tmp/junit2392792015498175258/checkpoints/5273b45840e0da6e6ca30141a2a11dd8/chk-65.
12:16:30.127 [INFO - flink-pekko.actor.default-dispatcher-5] (MasterHooks.java:201) No master state to restore
12:16:30.127 [INFO - flink-pekko.actor.default-dispatcher-5] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:30.137 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED.
12:16:30.138 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING.
12:16:30.138 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #2) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id da2c643a0e0cd56e531ac7783f030706
12:16:30.138 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.139 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.139 [DEBUG - pool-356-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.139 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:30.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.140 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.140 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.140 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.140 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.145 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to SCHEDULED.
12:16:30.145 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot da2c643a0e0cd56e531ac7783f030706.
12:16:30.146 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:30.146 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id da2c643a0e0cd56e531ac7783f030706.
12:16:30.146 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from SCHEDULED to DEPLOYING.
12:16:30.146 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #2) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id b54796e71d0c583e2956576d9a50fdec
12:16:30.146 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to SCHEDULED.
12:16:30.147 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot b54796e71d0c583e2956576d9a50fdec.
12:16:30.147 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:30.147 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2), deploy into slot with allocation id b54796e71d0c583e2956576d9a50fdec.
12:16:30.148 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
12:16:30.148 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
12:16:30.148 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6f4fe724
12:16:30.148 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:30.149 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:30.149 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:16:30.152 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CREATED to DEPLOYING.
12:16:30.152 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) [DEPLOYING].
12:16:30.152 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@598adde2
12:16:30.152 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:30.153 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:30.153 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:16:30.153 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from SCHEDULED to DEPLOYING.
12:16:30.153 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #2) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id 11655f63c26cfc770969daf002dc4f10
12:16:30.153 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to SCHEDULED.
12:16:30.153 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 11655f63c26cfc770969daf002dc4f10.
12:16:30.154 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from SCHEDULED to DEPLOYING.
12:16:30.154 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #2) with attempt id 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 9e1cd367-d5f4-490c-9d4d-a76e7e36981a @ 127.0.0.1 (dataPort=-1) with allocation id d35a590e069d52f250d74ff29b6a113a
12:16:30.154 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:30.154 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
12:16:30.154 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.154 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from DEPLOYING to INITIALIZING.
12:16:30.155 [INFO - Thread-66] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:30.155 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.19.5.126:41267(127.19.5.126:41267)] disconnecting while in state TERMINATED
12:16:30.155 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.19.5.124:34641(127.19.5.124:34641)] disconnecting while in state TERMINATED
12:16:30.155 [DEBUG - Thread-66] (Connection.java:575) [peer master-127.19.5.125:34511(127.19.5.125:34511)] disconnecting while in state TERMINATED
12:16:30.156 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:30.157 [INFO - Thread-66] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:30.157 [INFO - Thread-66] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:30.159 [DEBUG - Thread-66] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:30.159 [INFO - Thread-66] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:30.161 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:30.161 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:30.161 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:30.161 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:30.163 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4a89b7bb
12:16:30.163 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2), deploy into slot with allocation id 11655f63c26cfc770969daf002dc4f10.
12:16:30.165 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:30.172 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7be7d255
12:16:30.177 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:30.185 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot d35a590e069d52f250d74ff29b6a113a.
12:16:30.186 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2), deploy into slot with allocation id d35a590e069d52f250d74ff29b6a113a.
12:16:30.186 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CREATED to DEPLOYING.
12:16:30.186 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) [DEPLOYING].
12:16:30.187 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7645a49
12:16:30.187 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:30.187 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:30.187 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:16:30.187 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from DEPLOYING to INITIALIZING.
12:16:30.189 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@10fa3ba2
12:16:30.191 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:30.192 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.193 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.195 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CREATED to DEPLOYING.
12:16:30.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) [DEPLOYING].
12:16:30.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bef8040
12:16:30.196 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:30.197 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit2392792015498175258/checkpoints")
12:16:30.197 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:16:30.197 [INFO - flink-pekko.actor.default-dispatcher-5] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from DEPLOYING to INITIALIZING.
12:16:30.202 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.206 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@55b89ea5
12:16:30.207 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.208 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.208 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.208 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.213 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#2] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.213 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.213 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.213 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.227 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:30.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.243 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.244 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.244 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.244 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.244 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#2] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.245 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.245 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.245 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.249 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.249 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.249 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.251 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:30.251 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:30.251 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:30.251 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:30.251 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:30.251 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:30.251 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:30.251 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:30.251 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:30.251 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:30.251 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:30.251 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:30.251 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:30.253 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.253 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.263 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.263 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.264 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.264 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.264 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.264 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.265 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.265 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.265 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.269 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.269 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.269 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.269 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.269 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.270 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.270 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#2] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.274 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.281 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.281 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.281 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.281 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.293 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.293 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.293 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.293 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.293 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.294 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:30.294 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:30.294 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.294 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:30.294 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:30.294 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:30.294 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:30.294 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.294 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.294 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.294 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:30.294 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:30.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:30.295 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:30.295 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:30.295 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:30.295 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:30.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.302 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:30.302 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:30.302 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:30.302 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:30.302 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:30.302 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:30.302 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:30.302 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:30.302 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:30.303 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:30.303 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:30.303 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:30.303 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:30.305 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.305 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.305 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.305 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.305 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.306 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.306 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.306 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.306 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.306 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.306 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.307 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.313 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.313 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.313 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.314 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.314 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.314 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.314 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.314 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.314 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.316 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.316 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.316 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.316 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#2] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.317 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.317 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.317 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.318 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.319 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.319 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.322 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.322 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.323 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.323 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.323 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.323 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.332 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.333 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.334 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.334 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.334 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.334 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.334 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.334 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.335 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.335 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.335 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.335 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.335 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.335 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.335 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.336 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.343 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.343 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.343 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.343 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.343 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.344 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.344 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.344 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.344 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.344 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.344 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.344 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.344 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.348 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.349 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.349 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.349 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.352 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.352 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.352 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.352 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.353 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.353 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.353 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.353 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.353 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.353 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.354 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.354 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.354 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.354 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.354 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.354 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.354 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.354 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.356 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.365 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.365 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.365 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.365 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.368 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.368 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.368 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.369 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.369 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.371 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.372 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.372 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.372 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.372 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.372 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.372 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.373 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.373 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.373 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.373 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.373 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.373 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.373 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.373 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.373 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.373 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.378 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.378 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.378 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.378 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.379 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.379 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.379 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.379 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.381 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.382 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.384 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.384 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.384 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.386 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.386 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.386 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.386 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.386 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.393 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.393 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.393 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.394 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.394 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.394 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.394 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.394 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.395 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.395 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.395 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.395 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.395 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.395 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.395 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.395 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.396 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.396 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.396 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.403 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.403 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.403 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.403 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.403 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.403 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.403 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.403 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.404 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.404 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.404 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.404 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.412 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.412 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.412 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.413 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.413 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.413 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.413 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.413 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.413 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.413 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.413 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.416 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.416 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.416 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.417 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.417 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.417 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.417 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.417 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.417 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.417 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.417 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.417 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.417 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.417 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.418 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.418 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.418 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.418 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.418 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.418 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.422 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.422 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.422 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.423 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.423 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.423 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.423 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.423 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.423 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.423 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.424 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.429 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.429 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.429 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.430 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.430 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.430 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.430 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.430 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.430 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.430 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.430 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.430 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.430 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.434 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.434 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.434 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.434 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.434 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.434 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.434 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.434 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.434 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.435 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.435 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.435 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.435 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.435 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.435 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.435 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.435 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.435 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.435 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.436 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.436 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.436 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.436 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.436 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.436 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.436 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.444 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.444 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.444 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.444 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.444 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.453 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.453 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.453 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.454 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.454 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.454 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.454 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.454 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.454 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.454 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.454 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.454 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.454 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.455 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.455 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.455 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.455 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.455 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.455 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.455 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.455 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.455 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.456 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.456 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.456 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.456 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.456 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.456 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.456 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.456 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.456 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.456 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.456 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.462 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.462 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.462 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.462 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.463 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.463 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.463 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.463 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.463 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.463 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.463 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.463 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.463 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.476 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.476 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.477 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.477 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.477 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.477 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.477 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.477 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.482 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.483 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.483 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.483 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.483 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.483 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.483 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.483 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.483 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.484 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.484 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.484 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.484 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.493 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.493 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.494 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.494 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.494 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.494 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.494 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.494 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.494 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.494 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.494 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.494 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.495 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 41 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512990501 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:30.510 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 41 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:30.512 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.513 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.513 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.513 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.513 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 41 as completed for source Source: KuduSource.
12:16:30.513 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.513 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:30.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.513 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:30.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:30.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:30.514 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.513 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:30.514 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.514 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:30.514 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.514 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.514 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.515 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.515 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.515 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.515 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.515 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.515 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.515 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:30.515 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:30.515 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:30.514 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:30.516 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:30.516 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:30.516 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:30.515 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.516 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.516 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.533 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.533 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.534 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.534 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.541 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:30.542 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:30.542 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:30.542 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:30.542 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:30.542 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:30.542 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:30.542 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:30.542 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:30.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:30.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:30.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:30.543 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:30.556 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.556 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.556 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.557 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.557 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.557 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.557 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.557 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.557 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.557 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.575 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.575 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.575 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.575 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.575 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.575 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.575 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.575 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.575 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.575 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.624 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:30.624 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:30.625 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:30.625 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.625 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.625 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.625 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.625 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.625 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.625 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.625 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.625 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:30.632 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.633 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.633 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.633 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.633 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.633 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.633 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.633 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.634 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.634 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.634 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.634 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.672 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:30.673 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:30.673 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:30.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:30.674 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.674 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.674 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:30.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:30.674 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:30.690 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.690 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.690 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.691 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.691 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.691 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.691 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.691 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.691 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.691 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.691 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.691 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.692 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.714 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:30.714 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:30.714 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:30.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.715 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:30.715 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.715 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.715 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:30.715 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:30.715 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:30.743 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:30.743 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:30.743 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:30.744 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.744 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.744 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:30.744 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.744 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.744 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:30.744 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.745 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.745 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:30.745 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:30.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.794 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.794 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.794 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.795 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.795 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.795 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.795 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.795 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.795 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.795 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.795 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.796 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.796 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.815 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.815 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.815 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.816 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.816 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.816 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.816 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.816 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.816 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.817 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.817 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.817 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.817 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:30.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:30.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:30.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:30.983 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:30.983 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:30.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:30.985 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.985 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.985 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:30.985 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 42 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512991002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:31.025 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 42 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=23 ms, finalizationTime=0 ms).
12:16:31.026 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 42 as completed for source Source: KuduSource.
12:16:31.033 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.033 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.033 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.033 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.033 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.033 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.034 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.034 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.034 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.034 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.034 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.034 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.041 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:31.041 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:31.042 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:31.042 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.042 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.042 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.042 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.042 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.042 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.043 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.043 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.043 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:31.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:31.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:31.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:31.094 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.094 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.094 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.095 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.095 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.095 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.095 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.095 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:31.133 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.133 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.133 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.133 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.133 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.133 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.134 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.214 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.214 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.214 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.214 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.214 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.215 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.215 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.215 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.215 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.215 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.215 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.257 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.257 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.257 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.257 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.258 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.258 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.258 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.311 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:31.311 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:31.311 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:31.312 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.312 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.312 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.312 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.312 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.312 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.312 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.312 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.313 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.313 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:30.932358 24506 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 24443
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.351914 24506 kernel_stack_watchdog.cc:198] Thread 24443 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 397ms:
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:16:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:16:31.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:29.533373 24508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:31.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.353217 24443 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.820s	user 0.574s	sys 0.986s
12:16:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.353659 24509 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1819 milliseconds
12:16:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.354537 24443 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.821s	user 0.575s	sys 0.986s
12:16:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.355235 24443 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.355300 24510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:31.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.358412 24443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:31.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.360523 24443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.361893 24443 hybrid_clock.cc:648] HybridClock initialized: now 1783512991361851 us; error 37 us; skew 500 ppm
12:16:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.362697 24443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:31.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.368618 24443 webserver.cc:533] Webserver started at http://127.23.110.66:37221/ using document root <none> and password file <none>
12:16:31.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.369578 24443 fs_manager.cc:362] Metadata directory not provided
12:16:31.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.369798 24443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:31.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.370271 24443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.374583 24443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data/instance:
12:16:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bf22799a184117b4ce3874e955f2af"
12:16:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:31 on dist-test-slave-vcgh"
12:16:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.375695 24443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal/instance:
12:16:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bf22799a184117b4ce3874e955f2af"
12:16:31.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:31 on dist-test-slave-vcgh"
12:16:31.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.383806 24443 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
12:16:31.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.389943 24574 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:31.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.391315 24443 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.391672 24443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "45bf22799a184117b4ce3874e955f2af"
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:31 on dist-test-slave-vcgh"
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.391999 24443 fs_report.cc:389] FS layout report
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data/data
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:31.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:31.414 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:31.414 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:31.414 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:31.414 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.414 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.414 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:31.414 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:31.414 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.415 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.415 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:31.415 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.415017 24072 debug-util.cc:398] Leaking SignalData structure 0x7b080009b800 after lost signal to thread 24009
12:16:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:31.415603 24072 debug-util.cc:398] Leaking SignalData structure 0x7b0800070400 after lost signal to thread 24075
12:16:31.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.433 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.433 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.433 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.434 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.434 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.434 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.434 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.434 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.434 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.434 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.434 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.443799 24443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:31.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.445364 24443 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:31.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.445796 24443 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:31.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.448772 24443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:31.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.453604 24443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:31.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.453866 24443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:31.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.454102 24443 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:31.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.454263 24443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:31.468 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:31.468 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:31.468 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:31.468 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.468 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.468 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.468 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.468 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:31.468 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:31.469 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.469 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.469 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:31.469 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:31.482 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:31.482 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:31.482 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:31.482 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:31.482 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:31.483 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:31.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:31.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:31.483 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:31.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:31.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:31.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:31.483 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:31.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 43 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512991502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:31.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 43 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:31.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 43 as completed for source Source: KuduSource.
12:16:31.530 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:31.530 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:31.530 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:31.531 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.531 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.531 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.531 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.531 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.531 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.531 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.531 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.532 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.532 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:31.593 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.593 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.593 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.593 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.593 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.593 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.594 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.594 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.594 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.594 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.594 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.594 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.594 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.622498 24443 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.66:33115
12:16:31.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.622924 24686 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.66:33115 every 8 connection(s)
12:16:31.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.625116 24443 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/data/info.pb
12:16:31.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.629794 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24443
12:16:31.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.630227 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-1/wal/instance
12:16:31.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.664223 23993 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/logs
12:16:31.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data/info.pb
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.67:0
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.67
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.67
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:31.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:31.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.680111 24689 heartbeater.cc:344] Connected to a master server at 127.23.110.126:40817
12:16:31.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.680496 24689 heartbeater.cc:461] Registering TS with master...
12:16:31.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.681643 24689 heartbeater.cc:507] Master 127.23.110.126:40817 requested a full tablet report, sending...
12:16:31.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.681953 24687 heartbeater.cc:344] Connected to a master server at 127.23.110.124:37703
12:16:31.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.682289 24687 heartbeater.cc:461] Registering TS with master...
12:16:31.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.683156 24687 heartbeater.cc:507] Master 127.23.110.124:37703 requested a full tablet report, sending...
12:16:31.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.685007 24041 ts_manager.cc:194] Registered new tserver with Master: 45bf22799a184117b4ce3874e955f2af (127.23.110.66:33115)
12:16:31.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.685595 24688 heartbeater.cc:344] Connected to a master server at 127.23.110.125:35201
12:16:31.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.685950 24688 heartbeater.cc:461] Registering TS with master...
12:16:31.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.686213 24197 ts_manager.cc:194] Registered new tserver with Master: 45bf22799a184117b4ce3874e955f2af (127.23.110.66:33115)
12:16:31.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.686825 24688 heartbeater.cc:507] Master 127.23.110.125:35201 requested a full tablet report, sending...
12:16:31.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.688315 24197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.110.66:48855
12:16:31.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:31.694440 24117 ts_manager.cc:194] Registered new tserver with Master: 45bf22799a184117b4ce3874e955f2af (127.23.110.66:33115)
12:16:31.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.853 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.854 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.854 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.854 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.854 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.854 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.854 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.854 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.854 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.854 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.854 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.854 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.854 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.883 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:31.883 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:31.883 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:31.883 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.883 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.883 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:31.884 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.884 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.884 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:31.884 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.884 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.884 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:31.884 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:31.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:31.982 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:31.983 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:31.983 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:31.983 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.983 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:31.983 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.983 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.983 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:31.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:31.984 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:32.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 44 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512992002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:32.009 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 44 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:16:32.011 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 44 as completed for source Source: KuduSource.
12:16:32.013 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:32.013 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:32.013 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:32.014 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.014 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.014 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.014 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.014 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.014 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.014 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:32.040 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:32.041 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:32.041 [DEBUG - pool-372-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:32.041 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.041 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.041 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.042 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.042 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.042 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.042 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.042 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:32.043 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29671), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [11ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [38ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [38ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [64ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [65ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [463ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1082ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2822ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [6081ms] refreshing cache from master, [6081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [6083ms] too many traces: truncated at 100 traces, deferred=Deferred@923710131(state=PENDING, result=null, callback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780), errback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780)))
12:16:32.044 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:16:32.044 [WARN - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29671), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [11ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [38ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [38ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [64ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [65ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [463ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1082ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2822ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [6081ms] refreshing cache from master, [6081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [6083ms] too many traces: truncated at 100 traces, deferred=Deferred@923710131(state=PENDING, result=null, callback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780), errback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:32.044 [INFO - Source: KuduSource -> Sink: Writer (3/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4).
12:16:32.046 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#4 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:16:32.048 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4) switched from INITIALIZING to FAILED on 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29671), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [9ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [10ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [11ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [32ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [36ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [37ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [38ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [38ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [62ms] refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [64ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [65ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [65ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [102ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [105ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [105ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [143ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [202ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [202ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [222ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [223ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [223ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [240ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [462ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [463ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [463ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1081ms] refreshing cache from master, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [1082ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [1082ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2821ms] refreshing cache from master, [2821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2822ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2822ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [6081ms] refreshing cache from master, [6081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [6082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [6083ms] too many traces: truncated at 100 traces, deferred=Deferred@923710131(state=PENDING, result=null, callback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780), errback=(continuation of Deferred@1261013284 after retry RPC after error@1671496259) -> (continuation of Deferred@721274914 after retry RPC after error@1755610340) -> (continuation of Deferred@1875093629 after retry RPC after error@77274332) -> (continuation of Deferred@1088649397 after retry RPC after error@191594257) -> (continuation of Deferred@2031730241 after retry RPC after error@632823874) -> (continuation of Deferred@2118505104 after retry RPC after error@780577214) -> (continuation of Deferred@442098073 after retry RPC after error@2114418848) -> (continuation of Deferred@772207778 after retry RPC after error@894858117) -> (continuation of Deferred@1616251295 after retry RPC after error@634502989) -> (continuation of Deferred@1022098609 after retry RPC after error@984054514) -> (continuation of Deferred@1785566920 after retry RPC after error@1122924319) -> (continuation of Deferred@553846151 after retry RPC after error@544377791) -> (continuation of Deferred@640651951 after retry RPC after error@390615034) -> (continuation of Deferred@786325417 after retry RPC after error@449124030) -> (continuation of Deferred@1076188579 after retry RPC after error@357033410) -> (continuation of Deferred@1228456916 after retry RPC after error@2080001195) -> (continuation of Deferred@295208506 after retry RPC after error@995821630) -> (continuation of Deferred@879905506 after retry RPC after error@491046867) -> (continuation of Deferred@1220029207 after retry RPC after error@725733574) -> (continuation of Deferred@230861334 after retry RPC after error@906206754) -> (continuation of Deferred@1072360294 after retry RPC after error@436784061) -> (continuation of Deferred@33702128 after retry RPC after error@685386780)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.15.167.189:34023
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:32.049 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_4.
12:16:32.049 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#4) of source Source: KuduSource.
12:16:32.050 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:32.054 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.055 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.055 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.055 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.055 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.055 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.055 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.055 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.055 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.055 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.056 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29682), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [8ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [35ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [36ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [203ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [642ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1101ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2401ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3442ms] refreshing cache from master, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3443ms] too many traces: truncated at 100 traces, deferred=Deferred@1461176241(state=PENDING, result=null, callback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130), errback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130)))
12:16:32.057 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.057 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.057 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.057 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29682), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [8ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [35ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [36ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [203ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [642ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1101ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2401ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3442ms] refreshing cache from master, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3443ms] too many traces: truncated at 100 traces, deferred=Deferred@1461176241(state=PENDING, result=null, callback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130), errback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29682), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [8ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [35ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [36ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [203ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [642ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1101ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2401ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3442ms] refreshing cache from master, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3443ms] too many traces: truncated at 100 traces, deferred=Deferred@1461176241(state=PENDING, result=null, callback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130), errback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.124:41311
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:32.057 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.057 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.057 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.057 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.057 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.057 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.057 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.057 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.057 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.061 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29682), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [8ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [35ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [36ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [203ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [642ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1101ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2401ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3442ms] refreshing cache from master, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3443ms] too many traces: truncated at 100 traces, deferred=Deferred@1461176241(state=PENDING, result=null, callback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130), errback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=29, TimeoutTracker(timeout=30000, elapsed=29682), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [4ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [7ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [8ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [29ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [35ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [36ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [44ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [48ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [49ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [49ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [62ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [63ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [63ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [82ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [83ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [121ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [121ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [202ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [203ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [321ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [322ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [322ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [381ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [381ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [641ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [642ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [642ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1100ms] refreshing cache from master, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [1100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [1101ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [1101ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2400ms] refreshing cache from master, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [2400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.124:41311: Network error: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.125:46113: Network error: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113, [2401ms] Sub RPC ConnectToMaster: received response from server master-127.14.239.126:41849: Network error: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849, [2401ms] delaying RPC due to: Service unavailable: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311, [3442ms] refreshing cache from master, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.126:41849, [3442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.124:41311, [3443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.14.239.125:46113, [3443ms] too many traces: truncated at 100 traces, deferred=Deferred@1461176241(state=PENDING, result=null, callback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130), errback=(continuation of Deferred@1316987053 after retry RPC after error@1040974660) -> (continuation of Deferred@793416558 after retry RPC after error@1183441785) -> (continuation of Deferred@1975540173 after retry RPC after error@721969682) -> (continuation of Deferred@1344423422 after retry RPC after error@1505359528) -> (continuation of Deferred@784384611 after retry RPC after error@1177562459) -> (continuation of Deferred@75468246 after retry RPC after error@317007687) -> (continuation of Deferred@975056034 after retry RPC after error@2097382479) -> (continuation of Deferred@90875652 after retry RPC after error@1049520113) -> (continuation of Deferred@1967007678 after retry RPC after error@343860394) -> (continuation of Deferred@1148986278 after retry RPC after error@159409463) -> (continuation of Deferred@226992238 after retry RPC after error@1858035392) -> (continuation of Deferred@1274753442 after retry RPC after error@1104698423) -> (continuation of Deferred@1911292082 after retry RPC after error@1706101009) -> (continuation of Deferred@2010464804 after retry RPC after error@1953464589) -> (continuation of Deferred@1696069282 after retry RPC after error@142840464) -> (continuation of Deferred@1427776966 after retry RPC after error@1567994241) -> (continuation of Deferred@126742123 after retry RPC after error@319748888) -> (continuation of Deferred@389994666 after retry RPC after error@1740085877) -> (continuation of Deferred@262266462 after retry RPC after error@1796416137) -> (continuation of Deferred@168381641 after retry RPC after error@1370889167) -> (continuation of Deferred@1348762761 after retry RPC after error@571546470) -> (continuation of Deferred@1648260329 after retry RPC after error@53965570) -> (continuation of Deferred@1891944409 after retry RPC after error@1520707724) -> (continuation of Deferred@1269601805 after retry RPC after error@1941656345) -> (continuation of Deferred@622311608 after retry RPC after error@1577845982) -> (continuation of Deferred@1900015084 after retry RPC after error@1479891785) -> (continuation of Deferred@1090517647 after retry RPC after error@2129341626) -> (continuation of Deferred@1882586630 after retry RPC after error@36183130)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.14.239.124:41311
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:32.061 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:32.061 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
12:16:32.061 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#4) of source Source: KuduSource.
12:16:32.062 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:16:32.062 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to CANCELING.
12:16:32.062 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:16:32.063 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (SourceReaderBase.java:338) Closing Source Reader.
12:16:32.063 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
12:16:32.063 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#4 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4).
12:16:32.064 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#4 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4.
12:16:32.064 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CANCELING to CANCELED.
12:16:32.065 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:318) Clearing resource requirements of job c0988648dfcd43275159a42b4d64d13e
12:16:32.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.068848 24697 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:32.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.069391 24697 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:32.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.070006 24697 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:32.074 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.074 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.074 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.075 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.075 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.075 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.075 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.095 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.095 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.095 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.095 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.095 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.095 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.095 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.095 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.095 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.095 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.096 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.096 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.096 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.107900 24697 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:32.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.108952 24697 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.110.67
12:16:32.114 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.114 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.114 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.115 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.115 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.115 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.115 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.115 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.115 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.115 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.115 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.115 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.115 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.137 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.137 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.137 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.137 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.137 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.137 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.137 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.137 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.137 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.137 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.137 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.137 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.138 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:32.151877 24697 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.110.84:46367
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.110.67:0
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data/info.pb
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.110.67
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.110.126:40817,127.23.110.125:35201,127.23.110.124:37703
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.110.67
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/logs
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:32.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:32.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:32.153604 24697 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:32.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:32.155360 24697 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:32.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.168985 24706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:32.174 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.174 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.175 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.175 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.175 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.175 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.175 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.175 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.176 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.176 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.234 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.234 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.234 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.235 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.235 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.235 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.235 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.235 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.235 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.235 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.235 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.235 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.253 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.254 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:32.254 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:32.254 [DEBUG - pool-368-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:32.254 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.254 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.254 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:32.255 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.255 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.255 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:32.255 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.255 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.255 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.255 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.255 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.255 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.255 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:32.255 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.255 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.255 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:32.255 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.255 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.255 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.255 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.255 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.255 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.255 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.256 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=28, TimeoutTracker(timeout=30000, elapsed=29892), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [1ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [4ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [4ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [21ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [28ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [31ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [31ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [48ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [48ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [48ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [62ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [81ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [81ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [100ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [101ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [104ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [104ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [161ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [162ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [162ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [242ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [243ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [281ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [281ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [282ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [282ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [582ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [582ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [662ms] refreshing cache from master, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [663ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [663ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [664ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [664ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2420ms] refreshing cache from master, [2420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [2421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [2421ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.190:46157: Network error: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.188:40073: Network error: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073, [2422ms] Sub RPC ConnectToMaster: received response from server master-127.15.167.189:34023: Network error: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [2422ms] delaying RPC due to: Service unavailable: Master config (127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023, [3401ms] refreshing cache from master, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.190:46157, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.188:40073, [3401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.167.189:34023, [3401ms] too many traces: truncated at 100 traces, deferred=Deferred@957043675(state=PENDING, result=null, callback=(continuation of Deferred@1848249410 after retry RPC after error@580128443) -> (continuation of Deferred@1190414857 after retry RPC after error@620911751) -> (continuation of Deferred@460590201 after retry RPC after error@420952186) -> (continuation of Deferred@2102889811 after retry RPC after error@1250295834) -> (continuation of Deferred@1898633975 after retry RPC after error@1373567040) -> (continuation of Deferred@270715453 after retry RPC after error@1792974579) -> (continuation of Deferred@1300499517 after retry RPC after error@1807675701) -> (continuation of Deferred@1842068829 after retry RPC after error@1937542929) -> (continuation of Deferred@510951591 after retry RPC after error@39845125) -> (continuation of Deferred@852400454 after retry RPC after error@626891785) -> (continuation of Deferred@521552317 after retry RPC after error@1658597519) -> (continuation of Deferred@614367547 after retry RPC after error@1835727989) -> (continuation of Deferred@1079792588 after retry RPC after error@1124555520) -> (continuation of Deferred@331386114 after retry RPC after error@703808091) -> (continuation of Deferred@185841306 after retry RPC after error@1916089251) -> (continuation of Deferred@1695160442 after retry RPC after error@1448636186) -> (continuation of Deferred@1080669229 after retry RPC after error@463093672) -> (continuation of Deferred@778452329 after retry RPC after error@995337984) -> (continuation of Deferred@915846299 after retry RPC after error@2084285086) -> (continuation of Deferred@1672039685 after retry RPC after error@1164221911) -> (continuation of Deferred@1188416396 after retry RPC after error@1738270354) -> (continuation of Deferred@1324572161 after retry RPC after error@790165549) -> (continuation of Deferred@1207558121 after retry RPC after error@2137919218) -> (continuation of Deferred@733566024 after retry RPC after error@1132988546) -> (continuation of Deferred@1242009997 after retry RPC after error@1158746017) -> (continuation of Deferred@610998367 after retry RPC after error@665114696) -> (continuation of Deferred@1373224648 after retry RPC after error@486072149), errback=(continuation of Deferred@1848249410 after retry RPC after error@580128443) -> (continuation of Deferred@1190414857 after retry RPC after error@620911751) -> (continuation of Deferred@460590201 after retry RPC after error@420952186) -> (continuation of Deferred@2102889811 after retry RPC after error@1250295834) -> (continuation of Deferred@1898633975 after retry RPC after error@1373567040) -> (continuation of Deferred@270715453 after retry RPC after error@1792974579) -> (continuation of Deferred@1300499517 after retry RPC after error@1807675701) -> (continuation of Deferred@1842068829 after retry RPC after error@1937542929) -> (continuation of Deferred@510951591 after retry RPC after error@39845125) -> (continuation of Deferred@852400454 after retry RPC after error@626891785) -> (continuation of Deferred@521552317 after retry RPC after error@1658597519) -> (continuation of Deferred@614367547 after retry RPC after error@1835727989) -> (continuation of Deferred@1079792588 after retry RPC after error@1124555520) -> (continuation of Deferred@331386114 after retry RPC after error@703808091) -> (continuation of Deferred@185841306 after retry RPC after error@1916089251) -> (continuation of Deferred@1695160442 after retry RPC after error@1448636186) -> (continuation of Deferred@1080669229 after retry RPC after error@463093672) -> (continuation of Deferred@778452329 after retry RPC after error@995337984) -> (continuation of Deferred@915846299 after retry RPC after error@2084285086) -> (continuation of Deferred@1672039685 after retry RPC after error@1164221911) -> (continuation of Deferred@1188416396 after retry RPC after error@1738270354) -> (continuation of Deferred@1324572161 after retry RPC after error@790165549) -> (continuation of Deferred@1207558121 after retry RPC after error@2137919218) -> (continuation of Deferred@733566024 after retry RPC after error@1132988546) -> (continuation of Deferred@1242009997 after retry RPC after error@1158746017) -> (continuation of Deferred@610998367 after retry RPC after error@665114696) -> (continuation of Deferred@1373224648 after retry RPC after error@486072149)))
12:16:32.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.274 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.275 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.275 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.275 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.275 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.275 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.275 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.275 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.275 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.275 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.275 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:32.275 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:32.276 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:32.276 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.276 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.276 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.276 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.276 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.276 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.276 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.276 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.276 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.276 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:32.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:32.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:32.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:32.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:32.334 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:32.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:32.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:32.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:32.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:32.334 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:32.334 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:32.334 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:32.335 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:32.382 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:32.383 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:32.383 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:32.383 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.383 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.384 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.384 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.384 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.384 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.384 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.384 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:32.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:32.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:32.451 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:32.451 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.451 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.451 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.452 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.452 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.452 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.452 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.452 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.452 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.452 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:32.482 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:32.483 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:32.483 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:32.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.483 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.483 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.483 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:32.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:32.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.484 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:32.484 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:32.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 45 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512992502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:32.512 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 45 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:16:32.512 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:32.512 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:32.513 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:32.513 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.513 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.513 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.513 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.513 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:32.513 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:32.513 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.513 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.513 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:32.513 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:32.514 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 45 as completed for source Source: KuduSource.
12:16:32.574 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:32.574 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:32.574 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:32.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:32.575 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.575 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.575 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:32.575 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.575 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.575 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:32.575 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:32.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.643 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:32.643 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:32.643 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:32.643 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:32.644 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:32.644 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:32.644 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:32.644 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:32.644 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:32.644 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:32.644 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:32.644 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:32.644 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:32.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:32.692282 24687 heartbeater.cc:499] Master 127.23.110.124:37703 was elected leader, sending a full tablet report...
12:16:32.693 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:32.694 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:32.694 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:32.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:32.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:32.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:32.695 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:32.695 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:32.695 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:32.695 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:32.696 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:32.696 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:32.696 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:32.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:32.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 46 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512993002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:33.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 46 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:16:33.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 46 as completed for source Source: KuduSource.
12:16:33.053 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:33.053 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:33.053 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:33.054 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.054 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.054 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.054 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.054 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.054 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.055 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.055 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.055 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.055 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:33.113 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:33.114 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:33.114 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:33.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:33.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:33.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:33.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:33.114 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:33.114 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:33.114 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:33.114 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:33.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:33.115 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:33.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:33.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:33.256 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:33.257 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.257 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.257 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.257 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.257 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.257 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.257 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.257 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.257 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.257 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:33.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.434 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:33.434 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:33.434 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:33.435 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.435 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.435 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.435 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.435 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.435 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.435 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.435 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.435 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:33.455 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:33.456 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:33.456 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:33.456 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.456 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.456 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.456 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.456 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.457 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.457 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.457 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.457 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.457 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:33.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 47 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512993502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:33.511 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 47 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:33.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 47 as completed for source Source: KuduSource.
12:16:33.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:33.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:33.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:33.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:33.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:33.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:33.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:33.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:33.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:33.556 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:33.556 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:33.556 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:33.556 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:33.614 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:33.614 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:33.615 [DEBUG - pool-366-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:33.615 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.615 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:33.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:33.615 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:33.615 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:33.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.741 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:33.742 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:33.742 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:33.742 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.742 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.742 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.743 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.743 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.743 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.743 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.743 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.743 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.743 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:33.754 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:33.754 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:33.754 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:33.754 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.754 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.754 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:33.755 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.755 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.755 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:33.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.755 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.755 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:33.755 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:33.755 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:33.764479 24708 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1592 milliseconds
12:16:33.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:33.763687 24697 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.592s	user 0.001s	sys 0.001s
12:16:33.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:33.765298 24697 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.594s	user 0.001s	sys 0.001s
12:16:33.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:33.571363 24705 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 24697
12:16:33.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:32.170374 24707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:33.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.766093 24697 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:33.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:33.766290 24709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:33.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.770702 24697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:33.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.773445 24697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:33.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.774917 24697 hybrid_clock.cc:648] HybridClock initialized: now 1783512993774829 us; error 93 us; skew 500 ppm
12:16:33.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.775741 24697 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:33.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.782585 24697 webserver.cc:533] Webserver started at http://127.23.110.67:38933/ using document root <none> and password file <none>
12:16:33.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.783676 24697 fs_manager.cc:362] Metadata directory not provided
12:16:33.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.783895 24697 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:33.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.784511 24697 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:33.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.788983 24697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data/instance:
12:16:33.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0d4e99b44aa74c38b7d6bd2b759602a4"
12:16:33.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:33 on dist-test-slave-vcgh"
12:16:33.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.790184 24697 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal/instance:
12:16:33.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0d4e99b44aa74c38b7d6bd2b759602a4"
12:16:33.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:33 on dist-test-slave-vcgh"
12:16:33.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:33.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.797881 24697 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
12:16:33.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.803848 24717 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.805121 24697 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
12:16:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.805444 24697 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal
12:16:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0d4e99b44aa74c38b7d6bd2b759602a4"
12:16:33.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:33 on dist-test-slave-vcgh"
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.805769 24697 fs_report.cc:389] FS layout report
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data/data
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:33.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:33.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:33.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:33.842 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:33.842 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:33.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:33.842 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:33.842 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:33.842 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:33.843 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:33.843 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:33.843 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:33.843 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:33.843 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:33.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.863337 24697 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:33.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.864956 24697 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:33.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.865477 24697 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:33.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.868748 24697 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.873781 24697 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.874019 24697 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.874323 24697 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:33.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:33.874531 24697 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:33.902 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:33.903 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:33.903 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:33.903 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.903 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.903 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:33.903 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.903 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.903 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:33.904 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.904 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.904 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:33.904 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:33.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 48 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512994002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:34.033 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 48 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=30 ms, finalizationTime=0 ms).
12:16:34.034 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 48 as completed for source Source: KuduSource.
12:16:34.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.043026 24697 rpc_server.cc:307] RPC server started. Bound to: 127.23.110.67:40905
12:16:34.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.043136 24829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.110.67:40905 every 8 connection(s)
12:16:34.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.045830 24697 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/data/info.pb
12:16:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.052140 23993 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24697
12:16:34.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.052606 23993 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster12998424609065204069/ts-2/wal/instance
12:16:34.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.114429 24831 heartbeater.cc:344] Connected to a master server at 127.23.110.125:35201
12:16:34.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.114859 24830 heartbeater.cc:344] Connected to a master server at 127.23.110.124:37703
12:16:34.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.115160 24831 heartbeater.cc:461] Registering TS with master...
12:16:34.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.115307 24830 heartbeater.cc:461] Registering TS with master...
12:16:34.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.116394 24831 heartbeater.cc:507] Master 127.23.110.125:35201 requested a full tablet report, sending...
12:16:34.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.116420 24830 heartbeater.cc:507] Master 127.23.110.124:37703 requested a full tablet report, sending...
12:16:34.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.119079 24197 ts_manager.cc:194] Registered new tserver with Master: 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67:40905)
12:16:34.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.120914 24832 heartbeater.cc:344] Connected to a master server at 127.23.110.126:40817
12:16:34.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.120908 24197 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.110.67:41477
12:16:34.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.121241 24832 heartbeater.cc:461] Registering TS with master...
12:16:34.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.122081 24832 heartbeater.cc:507] Master 127.23.110.126:40817 requested a full tablet report, sending...
12:16:34.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.124504 24041 ts_manager.cc:194] Registered new tserver with Master: 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67:40905)
12:16:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.130230 24117 ts_manager.cc:194] Registered new tserver with Master: 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67:40905)
12:16:34.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.143116 23993 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:16:34.155 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:16:34.156 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:16:34.157 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.110.126"
      port: 40817
    }
    bound_http_address {
      host: "127.23.110.126"
      port: 39009
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.110.125"
      port: 35201
    }
    bound_http_address {
      host: "127.23.110.125"
      port: 38381
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.110.124"
      port: 37703
    }
    bound_http_address {
      host: "127.23.110.124"
      port: 34387
    }
  }
}

12:16:34.157 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:16:34.157 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.110.65"
      port: 42335
    }
    bound_http_address {
      host: "127.23.110.65"
      port: 44379
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.110.66"
      port: 33115
    }
    bound_http_address {
      host: "127.23.110.66"
      port: 37221
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.110.67"
      port: 40905
    }
    bound_http_address {
      host: "127.23.110.67"
      port: 38933
    }
  }
}

12:16:34.158 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:16:34.159 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.159 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:16:34.159 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgjdPqB/test-tmp
12:16:34.160 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:16:34.160 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgjdPqB/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:16:34.164 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:16:34.211 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:34.211 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:34.211 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:34.212 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.212 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.212 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.212 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.212 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.212 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.212 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.212 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.212 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.213 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:34.222 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:34.223 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:34.223 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:34.223 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:34.223 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:34.223 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:34.224 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:34.224 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:34.224 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:34.224 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:34.224 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:34.224 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:34.224 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:34.225 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:34.225 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:34.225 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:34.225 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.225 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.225 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.225 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.225 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.225 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.226 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.226 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.226 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.226 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:34.228 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:34.228 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:34.228 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:34.228 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.228 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.229 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.229 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.229 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.229 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.229 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.229 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.229 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:34.254 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.503 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:16:34.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 49 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512994502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:34.503 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:16:34.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.507808 24840 mini_oidc.cc:150] Starting JWKS server
12:16:34.509 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 49 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
12:16:34.509 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 49 as completed for source Source: KuduSource.
12:16:34.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.511503 24840 webserver.cc:533] Webserver started at http://127.0.0.1:34385/ using document root <none> and password file <none>
12:16:34.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.511950 24840 mini_oidc.cc:186] Starting OIDC Discovery server
12:16:34.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.513666 24840 webserver.cc:533] Webserver started at http://127.0.0.1:38029/ using document root <none> and password file <none>
12:16:34.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:16:34.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:34Z Disabled control of system clock
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.571242 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/logs
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data/info.pb
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:34.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.62:39483
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.62
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:34.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json with env {}
12:16:34.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.714 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:34.714 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:34.714 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:34.714 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:34.714 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:34.714 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:34.714 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:34.714 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:34.714 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:34.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:34.715 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:34.715 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:34.715 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:34.753 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.768 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:34.768 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:34.768 [DEBUG - pool-384-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:34.768 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.768 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.768 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.768 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.768 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.768 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.769 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:34.768 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:34.769 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:34.769 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:34.769 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27369), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [9ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [11ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [238ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [351ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [386ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [482ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [641ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1145ms] refreshing cache from master, [1145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1151ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2104ms] refreshing cache from master, [2104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2105ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2106ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5222ms] refreshing cache from master, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5224ms] too many traces: truncated at 100 traces, deferred=Deferred@1995759707(state=PENDING, result=null, callback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510), errback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510)))
12:16:34.771 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:34.771 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:34.772 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.772 [WARN - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27369), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [9ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [11ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [238ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [351ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [386ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [482ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [641ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1145ms] refreshing cache from master, [1145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1151ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2104ms] refreshing cache from master, [2104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2105ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2106ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5222ms] refreshing cache from master, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5224ms] too many traces: truncated at 100 traces, deferred=Deferred@1995759707(state=PENDING, result=null, callback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510), errback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:34.772 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:34.772 [INFO - Source: KuduSource -> Sink: Writer (1/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6).
12:16:34.772 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:34.772 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:34.772 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.772 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:34.773 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.773 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.773 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:34.773 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:34.776 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#6 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
12:16:34.778 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27369), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [9ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [10ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [11ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [11ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [21ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [238ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [240ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [241ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [241ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [350ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [350ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [351ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [386ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [442ms] refreshing cache from master, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [482ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [482ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [641ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [641ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1145ms] refreshing cache from master, [1145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1150ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1151ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2104ms] refreshing cache from master, [2104ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2105ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2106ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2106ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3063ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3063ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5222ms] refreshing cache from master, [5222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5223ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5224ms] too many traces: truncated at 100 traces, deferred=Deferred@1995759707(state=PENDING, result=null, callback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510), errback=(continuation of Deferred@33258301 after retry RPC after error@967594228) -> (continuation of Deferred@1067358582 after retry RPC after error@1849245926) -> (continuation of Deferred@876735631 after retry RPC after error@1865490691) -> (continuation of Deferred@607076538 after retry RPC after error@3480233) -> (continuation of Deferred@1001110452 after retry RPC after error@1576320251) -> (continuation of Deferred@50335087 after retry RPC after error@734572532) -> (continuation of Deferred@1306056482 after retry RPC after error@892582150) -> (continuation of Deferred@920363450 after retry RPC after error@1484918682) -> (continuation of Deferred@1407754863 after retry RPC after error@2075908765) -> (continuation of Deferred@268853793 after retry RPC after error@1487950180) -> (continuation of Deferred@1314745287 after retry RPC after error@1796681635) -> (continuation of Deferred@1218662282 after retry RPC after error@314707083) -> (continuation of Deferred@937713223 after retry RPC after error@1708918063) -> (continuation of Deferred@928106753 after retry RPC after error@905264436) -> (continuation of Deferred@553012139 after retry RPC after error@629589991) -> (continuation of Deferred@472255383 after retry RPC after error@10914234) -> (continuation of Deferred@312418582 after retry RPC after error@28665181) -> (continuation of Deferred@769899599 after retry RPC after error@431758096) -> (continuation of Deferred@1925193376 after retry RPC after error@1484067368) -> (continuation of Deferred@1757727917 after retry RPC after error@291061310) -> (continuation of Deferred@1671301035 after retry RPC after error@319471010) -> (continuation of Deferred@1575336650 after retry RPC after error@85317510)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:34.779 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#6) of source Source: KuduSource.
12:16:34.779 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:34.779 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_6.
12:16:34.779 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RUNNING to RESTARTING.
12:16:34.792 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (c0988648dfcd43275159a42b4d64d13e) switched from state RESTARTING to RUNNING.
12:16:34.793 [INFO - flink-pekko.actor.default-dispatcher-8] (CheckpointCoordinator.java:1805) Restoring job c0988648dfcd43275159a42b4d64d13e from Checkpoint 61 @ 1783512870892 for c0988648dfcd43275159a42b4d64d13e located at file:/tmp/junit5149282460191757602/checkpoints/c0988648dfcd43275159a42b4d64d13e/chk-61.
12:16:34.793 [INFO - flink-pekko.actor.default-dispatcher-8] (MasterHooks.java:201) No master state to restore
12:16:34.794 [INFO - flink-pekko.actor.default-dispatcher-8] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:34.794 [INFO - Thread-68] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:34.794 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED.
12:16:34.794 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.14.239.125:46113(127.14.239.125:46113)] disconnecting while in state TERMINATED
12:16:34.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.795 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.14.239.124:41311(127.14.239.124:41311)] disconnecting while in state TERMINATED
12:16:34.795 [DEBUG - Thread-68] (Connection.java:575) [peer master-127.14.239.126:41849(127.14.239.126:41849)] disconnecting while in state TERMINATED
12:16:34.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING.
12:16:34.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #5) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 9dafe0e73863499223c1fe58bd6fdace
12:16:34.795 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to SCHEDULED.
12:16:34.795 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:34.796 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:34.796 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 9dafe0e73863499223c1fe58bd6fdace.
12:16:34.797 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5), deploy into slot with allocation id 9dafe0e73863499223c1fe58bd6fdace.
12:16:34.797 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to DEPLOYING.
12:16:34.797 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:34.797 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) [DEPLOYING].
12:16:34.797 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from SCHEDULED to DEPLOYING.
12:16:34.797 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #5) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 696fbe6e4ee9274ca74773cf22d8f177
12:16:34.798 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to SCHEDULED.
12:16:34.798 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 696fbe6e4ee9274ca74773cf22d8f177.
12:16:34.798 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6655832a
12:16:34.798 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from SCHEDULED to DEPLOYING.
12:16:34.799 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #5) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 8fd498007e1e3ac575db3c4595d76811
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5), deploy into slot with allocation id 696fbe6e4ee9274ca74773cf22d8f177.
12:16:34.799 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to SCHEDULED.
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from SCHEDULED to DEPLOYING.
12:16:34.799 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #5) with attempt id 4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 0636c56a-84c2-49f6-b548-9c4dd9d18a33 @ 127.0.0.1 (dataPort=-1) with allocation id 0ed654e7eea26cf337f9e106a0b49044
12:16:34.800 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING.
12:16:34.800 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:34.801 [INFO - Thread-68] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:34.801 [INFO - Thread-68] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:34.801 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job c0988648dfcd43275159a42b4d64d13e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:34.801 [INFO - Source: KuduSource -> Sink: Writer (1/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@281d8334
12:16:34.802 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 8fd498007e1e3ac575db3c4595d76811.
12:16:34.803 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5), deploy into slot with allocation id 8fd498007e1e3ac575db3c4595d76811.
12:16:34.803 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 0ed654e7eea26cf337f9e106a0b49044.
12:16:34.803 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.804 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5), deploy into slot with allocation id 0ed654e7eea26cf337f9e106a0b49044.
12:16:34.804 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from CREATED to DEPLOYING.
12:16:34.804 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) [DEPLOYING].
12:16:34.805 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from CREATED to DEPLOYING.
12:16:34.805 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) [DEPLOYING].
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from CREATED to DEPLOYING.
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) [DEPLOYING].
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6723fe98
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a4f1791
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7e07ffc3
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:16:34.806 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit5149282460191757602/checkpoints")
12:16:34.806 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_3_5) switched from DEPLOYING to INITIALIZING.
12:16:34.807 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:16:34.807 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from DEPLOYING to INITIALIZING.
12:16:34.807 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#5 (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:16:34.807 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (4349378217306c7802066ab5ba0876c7_cbc357ccb763df2852fee8c4fc7d55f2_1_5) switched from DEPLOYING to INITIALIZING.
12:16:34.809 [INFO - Source: KuduSource -> Sink: Writer (4/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b716c37
12:16:34.810 [INFO - Source: KuduSource -> Sink: Writer (2/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@37ce6512
12:16:34.811 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b861ab9
12:16:34.814 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.815 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.815 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.816 [DEBUG - Thread-68] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:34.816 [INFO - Thread-68] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:34.823 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.825 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.825 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.829 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.829 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:34.829 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:34.829 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:34.829 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:34.830 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.830 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.830 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.830 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.832 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.833 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.833 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.833 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.834 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.834 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.834 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.834 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.835 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#5] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.835 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.835 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.835 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.835 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#5] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.836 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.836 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.836 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.836 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.836 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#5] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.837 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.837 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.837 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.845 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.845 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.845 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.845 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.846 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.846 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#5] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.846 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.846 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.846 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.846 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.847 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.847 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.847 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.847 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.847 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.847 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.848 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.848 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.848 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.848 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.849 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.849 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.849 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.849 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.849 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.849 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.849 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.849 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.850 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.850 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.850 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.850 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.850 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.850 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.851 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.851 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.851 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.851 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.851 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.851 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.851 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.856 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.857 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.857 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.857 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.857 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.859 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.859 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.859 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.859 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.863 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.864 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.864 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.864 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.864 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.864 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.865 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.865 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.865 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.865 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.865 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.865 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.865 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.865 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.866 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.865 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.866 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.866 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.866 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.869 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.869 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.869 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.869 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.869 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.869 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.870 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.876 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.877 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.877 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.877 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.877 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.881 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.884 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.885 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.885 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.885 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.885 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.890 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.890 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.890 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.890 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.892 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.896 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.897 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.897 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.897 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.897 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.897 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.897 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.897 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.897 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.897 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.898 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.898 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.898 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.899 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.899 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.899 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.899 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.899 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.899 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.905 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.906 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.906 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.906 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.906 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.906 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.906 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.907 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.907 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.907 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.907 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.907 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.907 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.907 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.907 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.907 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.908 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.908 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.908 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.908 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.909 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.910 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.910 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.910 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.910 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.910 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.910 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.910 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.910 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.910 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.910 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.910 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.914975 24852 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:34.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.915594 24852 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:34.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.916137 24852 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:34.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.917 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.917 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.917 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.917 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.917 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.917 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.917 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.917 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.917 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.923 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.923 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.924 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.924 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.924 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.924 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.924 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.924 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.924 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.924 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.925 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.925 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.925 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.926 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.926 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.926 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.926 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.926 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.926 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.926 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.926 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.926 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.927 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.925 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.925 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.927 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.927 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.927 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.927 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.927 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.930 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.930 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.930 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.930 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.930 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.930 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.930 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.930 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.930 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.930 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.930 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.930 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.930 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.937 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.937 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.937 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.937 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.938 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.938 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.938 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.938 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.938 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.938 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.938 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.938 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.938 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.944 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.944 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.944 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.944 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.944 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.944 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.944 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.944 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.944 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.944 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.944 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.944 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.945 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.946 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.946 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.946 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.946 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.946 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.946 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.946 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.946 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.946 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.946 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.947 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.947 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.947 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.947 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.954298 24852 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:34.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.954659 24852 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.954989 24852 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.955266 24852 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.955557 24852 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:34.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:34.955809 24852 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34385/jwks.json
12:16:34.957 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:34.957 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:34.957 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:34.957 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.957 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.957 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.957 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:34.957 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:34.957 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.957 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.957 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:34.957 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:34.964 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.964 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.964 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.965 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.965 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.965 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.965 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.965 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.965 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.965 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.965 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.965 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.966 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.966 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.966 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.966 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.966 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.966 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.966 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:34.969 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.969 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.970 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.970 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.970 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.970 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.970 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.970 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.970 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.970 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.970 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.984 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.984 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.984 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.984 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.984 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.984 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.984 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.984 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.984 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.984 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.984 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.984 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.984 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:34.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:34.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:34.985 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.985 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.985 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.985 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:34.985 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.985 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:34.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.986 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:34.986 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.997009 24852 master_runner.cc:387] Master server non-default flags:
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.62:39483
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data/info.pb
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.62
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/logs
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:34.998524 24852 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:35.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:35.000182 24852 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:35.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 50 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512995001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:35.008 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 50 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:16:35.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 50 as completed for source Source: KuduSource.
12:16:35.010 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.010 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.010 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.010 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.010 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.010 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.011 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.011 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.011 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.011 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:35.013808 24911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:35.017 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:35.017 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:35.017 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:35.018 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.018 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.018 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.018 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.018 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.018 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.018 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.018 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.019 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.019 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:35.025 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.025 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.026 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.026 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.026 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.026 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.026 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.026 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.026 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.026 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.026 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.026 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.026 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.046 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.046 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.046 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.046 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.046 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.046 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.046 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.046 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.047 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.047 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.047 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.047 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.057 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:35.057 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:35.057 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:35.058 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.058 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.058 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.058 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.058 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.058 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.058 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.058 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.058 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.058 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:35.085 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.086 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.086 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.086 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.086 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.086 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.086 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.086 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.086 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.086 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.086 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.087 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.087 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.097 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:35.097 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:35.097 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:35.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.098 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.098 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.098 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.098 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.098 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:35.104 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.104 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.105 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.105 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.105 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.105 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.105 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.105 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.105 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.105 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.105 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.105 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.105 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.105 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.106 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.106 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.106 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.105 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.106 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.106 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.106 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.106 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.106 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.106 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.106 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.107 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:35.128180 24830 heartbeater.cc:499] Master 127.23.110.124:37703 was elected leader, sending a full tablet report...
12:16:35.130 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.130 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.130 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.130 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:35.130 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.130 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:35.130 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.131 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:35.131 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:35.131 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:35.131 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:35.131 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:35.131 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:35.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.131 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:35.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.131 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.131 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.131 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.131 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.132 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:35.132 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:35.132 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:35.132 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:35.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.164 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.164 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.164 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.165 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.165 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.165 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.165 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.165 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.165 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.165 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.165 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.165 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.165 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.285 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.286 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.286 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.286 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.286 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.286 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.287 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.287 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.287 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.287 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.288 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.288 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.288 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.289 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.289 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.289 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.289 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.290 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.290 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.290 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.290 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.306 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.306 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.306 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.307 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.307 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.307 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.307 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.307 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.307 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.307 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.307 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.307 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.307 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.324 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.324 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.324 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.324 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.325 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.325 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.325 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.325 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.325 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.330 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.330 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.330 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.331 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.331 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.331 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.331 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.331 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.331 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.331 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.332 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.332 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.332 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.410 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.410 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.410 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.411 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.411 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.411 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.411 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.411 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.411 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.412 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.412 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.412 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.412 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:35.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:35.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:35.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.442 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.442 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.442 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.443 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.443 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.443 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.443 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:35.449 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:35.449 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:35.449 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:35.449 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.450 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.450 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.450 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.450 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.450 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.450 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.450 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.450 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.450 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:35.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 51 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512995501 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:35.507 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:35.507 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:35.507 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:35.508 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:35.508 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:35.508 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:35.508 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:35.508 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:35.508 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:35.508 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:35.508 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:35.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:35.508 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:35.520 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 51 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=19 ms, finalizationTime=0 ms).
12:16:35.521 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 51 as completed for source Source: KuduSource.
12:16:35.554 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:35.554 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:35.554 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:35.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:35.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:35.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:35.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:35.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:35.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:35.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:35.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:35.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:35.555 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:35.617 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:35.617 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:35.617 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:35.618 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.618 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.618 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:35.618 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.618 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.618 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:35.618 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.619 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.619 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:35.619 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:35.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.663 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:35.663 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:35.663 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:35.664 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.664 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.664 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.664 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.664 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.664 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.664 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.665 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.665 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.665 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:35.685 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.685 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.686 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.694 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.694 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.694 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.695 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.695 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.695 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.695 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.695 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.695 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.695 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.762 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:35.762 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:35.762 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:35.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:35.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:35.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:35.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:35.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:35.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:35.763 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:35.764 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:35.764 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:35.764 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:35.772 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:35.772 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:35.773 [DEBUG - pool-388-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:35.773 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.773 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.773 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.773 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.773 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.773 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.774 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.774 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.774 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.774 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:35.774 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28350), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [239ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [333ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [334ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [349ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [349ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [374ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [374ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [375ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [376ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [376ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [422ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [503ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [842ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [842ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1023ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3062ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [6361ms] refreshing cache from master, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6362ms] too many traces: truncated at 100 traces, deferred=Deferred@1038886487(state=PENDING, result=null, callback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664), errback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664)))
12:16:35.777 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (SourceReaderBase.java:338) Closing Source Reader.
12:16:35.777 [WARN - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28350), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [239ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [333ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [334ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [349ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [349ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [374ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [374ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [375ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [376ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [376ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [422ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [503ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [842ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [842ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1023ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3062ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [6361ms] refreshing cache from master, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6362ms] too many traces: truncated at 100 traces, deferred=Deferred@1038886487(state=PENDING, result=null, callback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664), errback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:35.777 [INFO - Source: KuduSource -> Sink: Writer (3/4)#5] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#5 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5).
12:16:35.779 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#5 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
12:16:35.781 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28350), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [237ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [238ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [239ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [239ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [333ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [334ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [349ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [349ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [374ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [374ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [375ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [375ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [376ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [376ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [403ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [403ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [421ms] refreshing cache from master, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [421ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [422ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [422ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [444ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [444ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [503ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [503ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [841ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [842ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [842ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1021ms] refreshing cache from master, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1023ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1701ms] refreshing cache from master, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1703ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1704ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3061ms] refreshing cache from master, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [3061ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [3062ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [3062ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [6361ms] refreshing cache from master, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [6361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [6362ms] too many traces: truncated at 100 traces, deferred=Deferred@1038886487(state=PENDING, result=null, callback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664), errback=(continuation of Deferred@65128329 after retry RPC after error@1294968998) -> (continuation of Deferred@987290930 after retry RPC after error@1725598368) -> (continuation of Deferred@1795871869 after retry RPC after error@1531980578) -> (continuation of Deferred@656235575 after retry RPC after error@354442750) -> (continuation of Deferred@682940955 after retry RPC after error@1919417620) -> (continuation of Deferred@1062661003 after retry RPC after error@672046642) -> (continuation of Deferred@644152618 after retry RPC after error@1806052271) -> (continuation of Deferred@1671733219 after retry RPC after error@1057448619) -> (continuation of Deferred@1049314764 after retry RPC after error@1680534241) -> (continuation of Deferred@590756352 after retry RPC after error@656414455) -> (continuation of Deferred@1138856698 after retry RPC after error@1890518405) -> (continuation of Deferred@1658574762 after retry RPC after error@1164702376) -> (continuation of Deferred@173203133 after retry RPC after error@47800671) -> (continuation of Deferred@1048809513 after retry RPC after error@619170787) -> (continuation of Deferred@945577716 after retry RPC after error@1908806457) -> (continuation of Deferred@1399244784 after retry RPC after error@1237628588) -> (continuation of Deferred@330693278 after retry RPC after error@1386970122) -> (continuation of Deferred@924281064 after retry RPC after error@1535826288) -> (continuation of Deferred@1733802389 after retry RPC after error@1846919769) -> (continuation of Deferred@1648994139 after retry RPC after error@1862640443) -> (continuation of Deferred@902050911 after retry RPC after error@1971531700) -> (continuation of Deferred@1516191008 after retry RPC after error@411128107) -> (continuation of Deferred@208922792 after retry RPC after error@1617008669) -> (continuation of Deferred@1131679500 after retry RPC after error@1374553664)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:35.783 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:35.785 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.786 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.786 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.787 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.787 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.787 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.787 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.787 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.787 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.787 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.787 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.787 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.788 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.789 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#5) of source Source: KuduSource.
12:16:35.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.796 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_5.
12:16:35.846 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.846 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.846 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.846 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.846 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.846 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.847 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.847 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.847 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.847 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.847 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.847 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.847 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.854 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:35.854 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:35.854 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:35.854 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.854 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.854 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:35.854 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.854 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.854 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:35.855 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.855 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.855 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:35.855 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:35.889 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:35.889 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:35.890 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:35.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:35.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.891 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.891 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:35.891 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.891 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.891 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:35.891 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:35.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.924 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:35.924 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:35.924 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:35.925 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.925 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.925 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.925 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.925 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:35.925 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:35.925 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.925 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.925 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:35.925 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:35.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:35.985 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:35.985 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:35.985 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:35.985 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.985 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.986 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.986 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.986 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.986 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.986 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.986 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.986 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.986 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:35.992 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:35.992 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:35.992 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:35.992 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.993 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.993 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:35.993 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.993 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.993 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:35.993 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.993 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.993 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:35.993 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:36.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 52 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512996002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:36.011 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 52 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:36.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 52 as completed for source Source: KuduSource.
12:16:36.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.146 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:36.146 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:36.146 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:36.146 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.146 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.146 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.147 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.147 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.147 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.147 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.147 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.147 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.147 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:36.190 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:36.190 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:36.190 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:36.191 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.191 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.191 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.191 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.191 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.191 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.191 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.191 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:36.237 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:36.237 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:36.237 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:36.237 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.237 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.237 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.237 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.237 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.237 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.237 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.237 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.238 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.238 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:36.296 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:36.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:36.343 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:36.344 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.344 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.344 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.344 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.344 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.344 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.344 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.344 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.344 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.344 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:36.366 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:36.366 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:36.367 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:36.367 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:36.367 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:36.367 [DEBUG - pool-390-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:36.368 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:36.368 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:36.368 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:36.372 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:36.372 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:36.372 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:36.372 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:36.373 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28918), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [152ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [310ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [317ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [317ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [339ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [365ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [453ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [453ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [502ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [741ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [742ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4181ms] refreshing cache from master, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4182ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556)))
12:16:36.374 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:36.374 [WARN - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28918), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [152ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [310ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [317ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [317ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [339ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [365ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [453ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [453ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [502ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [741ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [742ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4181ms] refreshing cache from master, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4182ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:36.374 [INFO - Source: KuduSource -> Sink: Writer (4/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6).
12:16:36.376 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#6 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
12:16:36.378 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28918), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [152ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [309ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [310ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [317ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [317ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [335ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [335ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [338ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [339ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [361ms] refreshing cache from master, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [365ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [365ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [382ms] refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [382ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [383ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [400ms] refreshing cache from master, [400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [453ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [453ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [480ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [481ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [481ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [501ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [502ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [502ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [581ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [581ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [582ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [582ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [741ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [741ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [742ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [742ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1620ms] refreshing cache from master, [1620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1621ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1622ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1622ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2100ms] refreshing cache from master, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [2100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [2101ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [2102ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [2102ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [4181ms] refreshing cache from master, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [4182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [4182ms] too many traces: truncated at 100 traces, deferred=Deferred@1806264292(state=PENDING, result=null, callback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556), errback=(continuation of Deferred@2004683719 after retry RPC after error@376746862) -> (continuation of Deferred@1104048884 after retry RPC after error@1635302254) -> (continuation of Deferred@2118432693 after retry RPC after error@1293452496) -> (continuation of Deferred@2146633301 after retry RPC after error@1534357774) -> (continuation of Deferred@5672138 after retry RPC after error@165787156) -> (continuation of Deferred@1850198227 after retry RPC after error@381888532) -> (continuation of Deferred@575133402 after retry RPC after error@647140752) -> (continuation of Deferred@1984155841 after retry RPC after error@2035275157) -> (continuation of Deferred@1705131360 after retry RPC after error@1471023697) -> (continuation of Deferred@1057164733 after retry RPC after error@946308277) -> (continuation of Deferred@1289418724 after retry RPC after error@1803653292) -> (continuation of Deferred@1279792772 after retry RPC after error@1208902036) -> (continuation of Deferred@1399900838 after retry RPC after error@873669780) -> (continuation of Deferred@946075812 after retry RPC after error@64634109) -> (continuation of Deferred@1454044122 after retry RPC after error@2075154975) -> (continuation of Deferred@1546730261 after retry RPC after error@241093050) -> (continuation of Deferred@267112328 after retry RPC after error@1995574472) -> (continuation of Deferred@592345232 after retry RPC after error@1529181786) -> (continuation of Deferred@182674745 after retry RPC after error@1821490401) -> (continuation of Deferred@1011602203 after retry RPC after error@1286403438) -> (continuation of Deferred@1568115567 after retry RPC after error@1012945556)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.252:40513
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:36.379 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:36.380 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#6) of source Source: KuduSource.
12:16:36.380 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_6.
12:16:36.403 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:36.403 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:36.403 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:36.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.404 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.404 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.404 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.404 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:36.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:36.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:36.453 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:36.454 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.454 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.454 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.454 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.454 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.454 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.454 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.454 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.454 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.454 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:36.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 53 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512996502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:36.511 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 53 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:36.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 53 as completed for source Source: KuduSource.
12:16:36.514 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:36.514 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:36.514 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:36.514 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:36.514 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:36.514 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:36.515 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:36.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:36.515 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:36.515 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:36.515 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:36.515 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:36.515 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:36.523 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:36.523 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:36.523 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:36.524 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.524 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.524 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:36.524 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.524 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.524 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:36.525 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.525 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.525 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:36.525 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:36.606 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:36.606 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:36.606 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:36.607 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.607 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.607 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.607 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.607 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.607 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.607 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.607 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.607 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:36.634 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:36.634 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:36.634 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:36.635 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:36.635 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:36.635 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:36.635 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:36.635 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:36.635 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:36.636 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:36.636 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:36.636 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:36.636 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:36.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.675 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:36.675 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:36.676 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:36.676 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.676 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.676 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.676 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.677 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.677 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.677 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.677 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.677 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:36.751 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:36.751 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:36.751 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:36.752 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:36.752 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:36.752 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:36.752 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:36.752 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:36.752 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:36.752 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:36.752 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:36.752 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:36.753 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:36.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:36.416145 24910 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 24852
12:16:36.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:36.793246 24852 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.780s	user 0.694s	sys 1.065s
12:16:36.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:36.793794 24852 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.780s	user 0.694s	sys 1.065s
12:16:36.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:35.014377 24912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:36.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:36.794905 24913 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1780 milliseconds
12:16:36.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:36.799630 24914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:36.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.799645 24852 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:36.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.801092 24852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:36.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.803553 24852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:36.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.804884 24852 hybrid_clock.cc:648] HybridClock initialized: now 1783512996804850 us; error 34 us; skew 500 ppm
12:16:36.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.805738 24852 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:36.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.811640 24852 webserver.cc:533] Webserver started at http://127.24.66.62:43493/ using document root <none> and password file <none>
12:16:36.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.812628 24852 fs_manager.cc:362] Metadata directory not provided
12:16:36.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.812876 24852 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:36.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.813299 24852 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:36.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.817878 24852 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data/instance:
12:16:36.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9f0dacf46154da49e1b17424889d74c"
12:16:36.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:36 on dist-test-slave-vcgh"
12:16:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.818943 24852 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal/instance:
12:16:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9f0dacf46154da49e1b17424889d74c"
12:16:36.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:36 on dist-test-slave-vcgh"
12:16:36.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.826402 24852 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
12:16:36.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.832211 24922 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:36.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.833305 24852 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:16:36.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.833611 24852 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9f0dacf46154da49e1b17424889d74c"
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:36 on dist-test-slave-vcgh"
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.833977 24852 fs_report.cc:389] FS layout report
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data/data
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:36.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:36.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.886144 24852 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:36.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.887656 24852 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:36.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.888166 24852 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:36.889 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:36.890 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:36.890 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:36.890 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.890 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.890 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:36.890 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.890 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.890 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:36.890 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.890 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.890 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:36.891 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:36.897 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:36.897 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:36.897 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:36.898 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.898 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.898 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.898 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.898 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:36.898 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:36.898 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.898 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.898 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:36.898 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:36.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.932 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:36.932 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:36.932 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:36.933 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.933 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.933 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.933 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:36.933 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:36.933 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.933 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.933 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:36.933 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:36.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.964262 24852 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.62:39483
12:16:36.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.964359 24973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.62:39483 every 8 connection(s)
12:16:36.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.967044 24852 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/data/info.pb
12:16:36.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:36.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.971230 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24852
12:16:36.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.971717 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-0/wal/instance
12:16:36.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.973994 24974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.976562 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/logs
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data/info.pb
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.61:43045
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.61
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:36.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json with env {}
12:16:36.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:36.987304 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
12:16:37.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 54 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512997002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:37.011 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 54 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:37.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 54 as completed for source Source: KuduSource.
12:16:37.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.019634 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
12:16:37.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.022234 24923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.026669 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.076114 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 1
12:16:37.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.081174 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.130 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:37.131 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:37.131 [DEBUG - pool-386-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:37.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:37.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:37.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:37.131 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:37.131 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:37.131 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:37.131 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:37.131 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:37.131 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:37.131 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:37.132 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29728), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [213ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [233ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [234ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [259ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [260ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [295ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [296ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [353ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [353ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [364ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [445ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [445ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [562ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [562ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [760ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1443ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1820ms] refreshing cache from master, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1821ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5760ms] refreshing cache from master, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5761ms] too many traces: truncated at 100 traces, deferred=Deferred@1222106457(state=PENDING, result=null, callback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114), errback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114)))
12:16:37.133 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (SourceReaderBase.java:338) Closing Source Reader.
12:16:37.133 [WARN - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29728), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [213ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [233ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [234ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [259ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [260ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [295ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [296ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [353ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [353ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [364ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [445ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [445ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [562ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [562ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [760ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1443ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1820ms] refreshing cache from master, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1821ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5760ms] refreshing cache from master, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5761ms] too many traces: truncated at 100 traces, deferred=Deferred@1222106457(state=PENDING, result=null, callback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114), errback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:37.133 [INFO - Source: KuduSource -> Sink: Writer (2/4)#6] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6).
12:16:37.134 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#6 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
12:16:37.137 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6) switched from INITIALIZING to FAILED on e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=29728), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [213ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [231ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [233ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [234ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [234ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [258ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [259ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [259ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [260ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [295ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [296ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [351ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [351ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [352ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [353ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [353ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [363ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [364ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [364ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [380ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [381ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [383ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [401ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [402ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [402ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [441ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [445ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [445ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [560ms] refreshing cache from master, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [561ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [562ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [562ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [680ms] refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [681ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [681ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [760ms] refreshing cache from master, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [760ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [761ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [761ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1441ms] refreshing cache from master, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1442ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1443ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1443ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1820ms] refreshing cache from master, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [1820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.254:45345: Network error: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.252:40513: Network error: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513, [1821ms] Sub RPC ConnectToMaster: received response from server master-127.13.164.253:36317: Network error: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [1821ms] delaying RPC due to: Service unavailable: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317, [5760ms] refreshing cache from master, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.254:45345, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.252:40513, [5760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.13.164.253:36317, [5761ms] too many traces: truncated at 100 traces, deferred=Deferred@1222106457(state=PENDING, result=null, callback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114), errback=(continuation of Deferred@843592550 after retry RPC after error@447305248) -> (continuation of Deferred@1572085993 after retry RPC after error@738136851) -> (continuation of Deferred@1491064329 after retry RPC after error@144151396) -> (continuation of Deferred@1951943159 after retry RPC after error@661433316) -> (continuation of Deferred@27614878 after retry RPC after error@891154813) -> (continuation of Deferred@62656984 after retry RPC after error@1104001472) -> (continuation of Deferred@1782013641 after retry RPC after error@813423851) -> (continuation of Deferred@1395272173 after retry RPC after error@2139458033) -> (continuation of Deferred@798249438 after retry RPC after error@1097227331) -> (continuation of Deferred@1132552387 after retry RPC after error@270050115) -> (continuation of Deferred@487529023 after retry RPC after error@1853413785) -> (continuation of Deferred@649542637 after retry RPC after error@1935709891) -> (continuation of Deferred@383493234 after retry RPC after error@1044841249) -> (continuation of Deferred@556810071 after retry RPC after error@1452368700) -> (continuation of Deferred@497198504 after retry RPC after error@469426998) -> (continuation of Deferred@999341465 after retry RPC after error@1724232020) -> (continuation of Deferred@1858258881 after retry RPC after error@577600124) -> (continuation of Deferred@481261533 after retry RPC after error@1462450701) -> (continuation of Deferred@799998950 after retry RPC after error@1717052149) -> (continuation of Deferred@28221564 after retry RPC after error@257628438) -> (continuation of Deferred@1488751400 after retry RPC after error@2136233280) -> (continuation of Deferred@185448342 after retry RPC after error@1556716616) -> (continuation of Deferred@1611704626 after retry RPC after error@1026760229) -> (continuation of Deferred@1533325074 after retry RPC after error@1272923114)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.13.164.253:36317
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:37.138 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 8680f415d5d255088cd51ec1e8014bb4
12:16:37.138 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#6) of source Source: KuduSource.
12:16:37.138 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_6.
12:16:37.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.149601 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 2
12:16:37.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.155411 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.174 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:37.174 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:37.174 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:37.174 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:37.174 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:37.174 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:37.174 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:37.174 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:37.174 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:37.174 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:37.174 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:37.174 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:37.174 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:37.203 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:37.204 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:37.204 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:37.204 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:37.204 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:37.204 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:37.204 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:37.204 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:37.204 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:37.204 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:37.204 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:37.204 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:37.204 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:37.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.246812 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 3
12:16:37.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.251219 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.310886 24976 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:37.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.311483 24976 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:37.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.312053 24976 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:37.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.346835 24976 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:37.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.347107 24976 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:37.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.347311 24976 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:37.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.347568 24976 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:37.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.347817 24976 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:37.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.348013 24976 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34385/jwks.json
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.387024 24976 master_runner.cc:387] Master server non-default flags:
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.61:43045
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data/info.pb
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.61
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/logs
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:37.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:37.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:37.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:37.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:37.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.388332 24976 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:37.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.389945 24976 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:37.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.394590 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 4
12:16:37.396 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:37.396 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:37.396 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:37.396 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.396 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.396 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.396 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.396 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.397 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.397 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.397 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:37.402 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.402 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.402 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.402657 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.403 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.403 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.403 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.403030 24985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:37.403 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.403 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.403 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.403 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.403 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.403 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.404 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.404 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29949), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [154ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [176ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [264ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [303ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [365ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [365ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1042ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1503ms] refreshing cache from master, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1505ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1841492331(state=PENDING, result=null, callback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336), errback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336)))
12:16:37.405 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.405 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.405 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.405 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.405 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29949), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [154ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [176ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [264ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [303ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [365ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [365ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1042ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1503ms] refreshing cache from master, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1505ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1841492331(state=PENDING, result=null, callback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336), errback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29949), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [154ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [176ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [264ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [303ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [365ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [365ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1042ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1503ms] refreshing cache from master, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1505ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1841492331(state=PENDING, result=null, callback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336), errback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:37.405 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.405 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.406 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.406 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.405 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.406 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.406 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.406 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.406 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.410 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29949), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [154ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [176ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [264ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [303ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [365ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [365ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1042ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1503ms] refreshing cache from master, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1505ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1841492331(state=PENDING, result=null, callback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336), errback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=29949), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [38ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [39ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [40ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [40ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [63ms] refreshing cache from master, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [139ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [139ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [154ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [154ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [176ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [264ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [266ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [266ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [282ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [282ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [301ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [302ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [303ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [322ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [323ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [323ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [364ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [365ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [365ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [481ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [481ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [482ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [482ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [602ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [602ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1041ms] refreshing cache from master, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1042ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1042ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1503ms] refreshing cache from master, [1503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1504ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1504ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1505ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1505ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1801ms] refreshing cache from master, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [1801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.254:35497: Network error: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497, [1802ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.252:39469: Network error: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469, [1803ms] Sub RPC ConnectToMaster: received response from server master-127.12.238.253:35475: Network error: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [1803ms] delaying RPC due to: Service unavailable: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475, [2840ms] refreshing cache from master, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.254:35497, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.252:39469, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.238.253:35475, [2841ms] too many traces: truncated at 100 traces, deferred=Deferred@1841492331(state=PENDING, result=null, callback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336), errback=(continuation of Deferred@1064691635 after retry RPC after error@1950758577) -> (continuation of Deferred@2109596658 after retry RPC after error@118365319) -> (continuation of Deferred@391523242 after retry RPC after error@1390437455) -> (continuation of Deferred@1079033746 after retry RPC after error@936212795) -> (continuation of Deferred@291507987 after retry RPC after error@1089717100) -> (continuation of Deferred@94001359 after retry RPC after error@1505951206) -> (continuation of Deferred@1212905818 after retry RPC after error@385690524) -> (continuation of Deferred@1098270124 after retry RPC after error@253078953) -> (continuation of Deferred@470254776 after retry RPC after error@1675230575) -> (continuation of Deferred@275881885 after retry RPC after error@850067679) -> (continuation of Deferred@304705654 after retry RPC after error@1043842521) -> (continuation of Deferred@572930293 after retry RPC after error@1214347670) -> (continuation of Deferred@294787628 after retry RPC after error@285936842) -> (continuation of Deferred@41512846 after retry RPC after error@1100417950) -> (continuation of Deferred@1079327482 after retry RPC after error@166794086) -> (continuation of Deferred@1077741769 after retry RPC after error@957292715) -> (continuation of Deferred@1357139866 after retry RPC after error@1359940803) -> (continuation of Deferred@2036084075 after retry RPC after error@957759635) -> (continuation of Deferred@1274826932 after retry RPC after error@1648112668) -> (continuation of Deferred@2048096837 after retry RPC after error@1896529740) -> (continuation of Deferred@1482307625 after retry RPC after error@1531280362) -> (continuation of Deferred@979760021 after retry RPC after error@514972490) -> (continuation of Deferred@396571589 after retry RPC after error@1741263088) -> (continuation of Deferred@1915043527 after retry RPC after error@1658769474) -> (continuation of Deferred@1819142855 after retry RPC after error@1191754154) -> (continuation of Deferred@478176394 after retry RPC after error@147389336)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.12.238.253:35475
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:37.410 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:37.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.422 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.422 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.422 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.423 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.423 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.423 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.423 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.423 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.423 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.423 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.423 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.441 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.442 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.442 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.442 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.442 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.442 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.442 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.442 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.442 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.442 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.442 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.442 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.442 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.453 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:37.453 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:37.453 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:37.454 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:37.454 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:37.454 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:37.454 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:37.454 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:37.454 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:37.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:37.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:37.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:37.455 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:37.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.462 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.463 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.463 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.463 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.463 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.463 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.463 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.463 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.463 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.463 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.463 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.474 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:37.474 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:37.474 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:37.474 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.475 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.475 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:37.475 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.475 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.475 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:37.474 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:37.475 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:37.482 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.482 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.482 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.482 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.482 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.482 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.482 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.482 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.482 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.483 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.483 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.483 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.483 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 55 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512997502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:37.510 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 55 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:16:37.511 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 55 as completed for source Source: KuduSource.
12:16:37.521 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.522 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.522 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.522 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.522 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.522 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.522 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.522 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.522 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.522 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.522 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.522 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.522 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.582 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.582 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.583 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.583 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.583 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.583 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.584 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.584 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.584 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.661 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.662 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.662 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.662 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.662 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.662 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.662 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.662 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.662 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.662 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.663 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.663 [INFO - pool-382-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.663 [WARN - pool-382-thread-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:37.702143 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 5
12:16:37.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.707854 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:37.762 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.762 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.762 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.763 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.763 [INFO - pool-382-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.763 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.763 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.781 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:37.781 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:37.781 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:37.782 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.782 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.782 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.782 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.782 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.782 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.782 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.782 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.782 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.782 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:37.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:37.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:37.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:37.802 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.802 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.802 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:37.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.803 [INFO - pool-382-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:37.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.803 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:37.803 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:37.901 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:37.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:37.902 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:37.902 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.902 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.902 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.902 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.902 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:37.902 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:37.903 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.903 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.903 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:37.903 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:37.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:37.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.004 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 56 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512998002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:38.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 56 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=1 ms).
12:16:38.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 56 as completed for source Source: KuduSource.
12:16:38.124 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:38.125 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:38.125 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:38.125 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:38.125 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:38.125 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:38.125 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:38.125 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:38.125 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:38.125 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:38.126 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:38.126 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:38.126 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:38.134 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:38.134 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:38.134 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:38.134 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.134 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.134 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.135 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.135 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.135 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.135 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.135 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.135 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.135 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:38.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.154 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:38.154 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:38.154 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:38.155 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:38.155 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:38.155 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:38.155 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:38.155 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:38.155 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:38.155 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:38.155 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:38.156 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:38.156 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:38.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.255376 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 6
12:16:38.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:38.274250 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.61:43045: Network error: Client connection negotiation failed: client connection to 127.24.66.61:43045: connect: Connection refused (error 111)
12:16:38.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.401 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:38.401 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:38.401 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:38.402 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.402 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.402 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.402 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.402 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.402 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.403 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.403 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.403 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.403 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:38.413 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:38.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:38.414 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:38.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:38.414 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:38.414 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.414 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.415 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:38.415 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:38.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.475 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:38.475 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:38.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:38.476 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:38.476 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:38.476 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:38.476 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:38.476 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:38.476 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:38.476 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:38.476 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:38.476 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:38.476 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:38.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 57 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512998502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:38.510 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 57 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:16:38.510 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 57 as completed for source Source: KuduSource.
12:16:38.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.407269 24988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:38.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:37.406399 24986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:38.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:38.617637 24987 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1211 milliseconds
12:16:38.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.617789 24976 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:38.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.619153 24976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:38.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.622265 24976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:38.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.623796 24976 hybrid_clock.cc:648] HybridClock initialized: now 1783512998623753 us; error 41 us; skew 500 ppm
12:16:38.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.624861 24976 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.632575 24976 webserver.cc:533] Webserver started at http://127.24.66.61:37485/ using document root <none> and password file <none>
12:16:38.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.633733 24976 fs_manager.cc:362] Metadata directory not provided
12:16:38.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.633919 24976 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:38.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.634352 24976 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:38.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.638790 24976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data/instance:
12:16:38.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9fd487c36d4ceca21c763b0f507afd"
12:16:38.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:38 on dist-test-slave-vcgh"
12:16:38.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.639832 24976 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal/instance:
12:16:38.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9fd487c36d4ceca21c763b0f507afd"
12:16:38.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:38 on dist-test-slave-vcgh"
12:16:38.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.647303 24976 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.004s
12:16:38.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.652828 24997 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.653954 24976 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
12:16:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.654259 24976 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal
12:16:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ec9fd487c36d4ceca21c763b0f507afd"
12:16:38.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:38 on dist-test-slave-vcgh"
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.654567 24976 fs_report.cc:389] FS layout report
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data/data
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:38.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:38.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.715514 24976 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:38.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.717303 24976 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:38.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.717814 24976 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:38.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.793649 24976 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.61:43045
12:16:38.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.793701 25048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.61:43045 every 8 connection(s)
12:16:38.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.796828 24976 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/data/info.pb
12:16:38.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:38.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:38.802 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:38.802 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:38.802 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:38.802 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:38.802 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:38.802 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:38.802 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:38.802 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:38.802 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:38.802 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:38.802 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:38.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.803150 25049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:38.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.804064 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 24976
12:16:38.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.804419 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-1/wal/instance
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.807174 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/logs
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data/info.pb
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.60:33469
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.60
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json with env {}
12:16:38.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.816164 25049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
12:16:38.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.853302 25049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
12:16:38.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.871167 25049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } has no permanent_uuid. Determining permanent_uuid...
12:16:38.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:38.874120 24999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:38.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:38.878616 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:38.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:38.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:38.928099 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 1
12:16:38.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:38.932379 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:38.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.000790 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 2
12:16:39.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 58 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512999002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:39.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.010084 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.011 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 58 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:39.012 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 58 as completed for source Source: KuduSource.
12:16:39.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.101523 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 3
12:16:39.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.106652 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.149219 25051 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:39.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.149783 25051 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:39.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.150269 25051 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:39.162 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:39.163 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:39.163 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:39.163 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.163 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.163 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.163 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.163 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.163 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.163 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.163 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.188860 25051 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:16:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.189193 25051 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.189415 25051 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:16:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.189649 25051 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:16:39.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.189841 25051 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:16:39.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:39.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:39.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:39.190 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.190 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.190 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.190009 25051 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34385/jwks.json
12:16:39.190 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.190 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.190 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.190 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.190 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.190 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.231668 25051 master_runner.cc:387] Master server non-default flags:
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.60:33469
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34385/jwks.json
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data/info.pb
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.60
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/logs
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:39.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:39.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.233374 25051 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:39.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.235041 25051 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:39.243 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:39.243 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:39.243 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:39.244 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.244 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.244 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.244 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.244 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.244 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.244 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.244 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.244 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.244 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:39.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.246563 25062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:39.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.250093 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 4
12:16:39.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.254504 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.334748 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } attempt: 7
12:16:39.341 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:39.342 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:39.342 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:39.342 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:39.342 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:39.342 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:39.343 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:39.343 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:39.343 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:39.342 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:39.343 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:39.343 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:39.343 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:39.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.352874 24974 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } has no permanent_uuid. Determining permanent_uuid...
12:16:39.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.358958 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.417377 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 1
12:16:39.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.421902 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 59 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783512999502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:39.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.503309 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 2
12:16:39.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.509084 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.511 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 59 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:39.511 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 59 as completed for source Source: KuduSource.
12:16:39.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.553885 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 5
12:16:39.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.558341 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.594496 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 3
12:16:39.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.599210 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:39.739706 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 4
12:16:39.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.746842 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:39.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:39.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:39.754 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:39.754 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.755 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.755 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:39.755 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.755 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:39.755 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.755 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.755 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:39.755 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:39.790 [DEBUG - pool-394-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30012), Traces: [0ms] sending RPC to server master-127.21.36.190:33455, [6ms] received response from server master-127.21.36.190:33455: OK, deferred=null) with no deferred attached!
12:16:39.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.802 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:39.802 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:39.802 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:39.803 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.803 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.803 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:39.803 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.803 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.803 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:39.803 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.803 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.803 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:39.803 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:39.823 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:39.823 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:39.823 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:39.824 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.824 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.824 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:39.824 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.824 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.824 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:39.825 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.825 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.825 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:39.825 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:39.911 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:39.911 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:39.911 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:39.911 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:39.911 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:39.911 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:39.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:39.911 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:39.911 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:39.912 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:39.912 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:39.912 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:39.912 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:39.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:39.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:39.946 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:39.946 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:39.946 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:39.946 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:39.946 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:39.946 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:39.946 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:39.946 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:39.946 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:39.947 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:39.947 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:39.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:39.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:39.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:39.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:39.975 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:39.975 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:39.975 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:39.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:39.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:39.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:39.975 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:39.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:39.975 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:39.975 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:40.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 60 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513000001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:40.008 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 60 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:16:40.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 60 as completed for source Source: KuduSource.
12:16:40.023 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:40.023 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:40.023 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:40.024 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.024 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.024 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.024 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.024 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.024 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.024 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.024 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.024 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.024 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:40.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.030333 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 5
12:16:40.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.041164 24974 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:40.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.105784 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 6
12:16:40.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.112960 25049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.24.66.60:33469: Network error: Client connection negotiation failed: client connection to 127.24.66.60:33469: connect: Connection refused (error 111)
12:16:40.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.225 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:40.225 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:40.225 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:40.225 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.225 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.225 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.225 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.225 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.225 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.226 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.226 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.226 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.226 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:40.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.310 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:40.310 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:40.310 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:40.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:40.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:40.311 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:40.311 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:40.311 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:40.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:40.311 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:40.311 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:40.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:40.311 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:40.312 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:40.312 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:40.313 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:40.313 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.313 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.313 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.313 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.313 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.313 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.313 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.313 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.313 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.313 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:40.370 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:40.370 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:40.370 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:40.371 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.371 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.371 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.371 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.371 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.371 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.371 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.371 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.371 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.371 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:40.375 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [14ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.375 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [14ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.375 [DEBUG - pool-396-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30003), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [12ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.404 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:40.404 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:40.404 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:40.404 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.404 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.404 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.404 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.404 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.404 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.405 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.405 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.405 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.405 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:40.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.250207 25065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:40.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:39.248328 25063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:40.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.413571 25064 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
12:16:40.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.414171 25051 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:40.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.418596 25051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:40.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.421196 25051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:40.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.422580 25051 hybrid_clock.cc:648] HybridClock initialized: now 1783513000422543 us; error 39 us; skew 500 ppm
12:16:40.423 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.423696 25051 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:40.424 [DEBUG - pool-402-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30001), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [7ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.429952 25051 webserver.cc:533] Webserver started at http://127.24.66.60:42445/ using document root <none> and password file <none>
12:16:40.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.430823 25051 fs_manager.cc:362] Metadata directory not provided
12:16:40.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.431031 25051 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:40.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.431447 25051 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:40.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.436041 25051 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data/instance:
12:16:40.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2495bcf05fe44f6686dcc3b4e10550ad"
12:16:40.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:40 on dist-test-slave-vcgh"
12:16:40.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.437095 25051 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal/instance:
12:16:40.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2495bcf05fe44f6686dcc3b4e10550ad"
12:16:40.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:40 on dist-test-slave-vcgh"
12:16:40.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.444382 25051 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
12:16:40.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.450346 25078 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:40.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.451632 25051 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.451982 25051 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2495bcf05fe44f6686dcc3b4e10550ad"
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:40 on dist-test-slave-vcgh"
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.452317 25051 fs_report.cc:389] FS layout report
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data/data
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:40.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:40.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:40.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:40.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:40.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:40.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.474 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [22ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.475 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30010), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [23ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.475 [DEBUG - pool-400-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30009), Traces: [0ms] sending RPC to server master-127.21.224.189:39039, [22ms] received response from server master-127.21.224.189:39039: OK, deferred=null) with no deferred attached!
12:16:40.475 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:40.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:40.476 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:40.476 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.476 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.476 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.476 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.476 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:40.476 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:40.476 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.476 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.476 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:40.476 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:40.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 61 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513000501 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:40.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.503543 25051 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:40.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.505797 25051 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:40.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.506247 25051 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:40.509 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 61 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:16:40.509 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 61 as completed for source Source: KuduSource.
12:16:40.562 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:40.562 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:40.562 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:40.562 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.562 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.562 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.562 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:40.562 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.562 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:40.563 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.563 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.563 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:40.563 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:40.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.579780 25051 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.60:33469
12:16:40.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.579843 25129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.60:33469 every 8 connection(s)
12:16:40.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.582595 25051 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/data/info.pb
12:16:40.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.586699 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 25051
12:16:40.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.587180 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/master-2/wal/instance
12:16:40.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.589741 25130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:40.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.594437 24974 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 6
12:16:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.636499 25130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
12:16:40.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.640566 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: Bootstrap starting.
12:16:40.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.648149 24974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: Neither blocks nor log segments found. Creating new log.
12:16:40.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.650451 24974 log.cc:826] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: Log is configured to *not* fsync() on all Append() calls
12:16:40.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.655985 25130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } has no permanent_uuid. Determining permanent_uuid...
12:16:40.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.665729 25130 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } has no permanent_uuid. Determining permanent_uuid...
12:16:40.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.673205 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: No bootstrap required, opened a new log
12:16:40.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.683746 25130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: Bootstrap starting.
12:16:40.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.692013 25130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: Neither blocks nor log segments found. Creating new log.
12:16:40.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.694427 25130 log.cc:826] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: Log is configured to *not* fsync() on all Append() calls
12:16:40.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.699812 25130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: No bootstrap required, opened a new log
12:16:40.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.700613 24974 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.701471 24974 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:40.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.701751 24974 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9f0dacf46154da49e1b17424889d74c, State: Initialized, Role: FOLLOWER
12:16:40.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.702657 24974 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.705343 25141 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.706244 25141 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: This master's current role is: FOLLOWER
12:16:40.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.707060 24974 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: configured and running, proceeding with master startup.
12:16:40.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.727380 25130 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.728354 25130 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:40.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.728650 25130 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2495bcf05fe44f6686dcc3b4e10550ad, State: Initialized, Role: FOLLOWER
12:16:40.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.729614 25130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.732915 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.733666 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: This master's current role is: FOLLOWER
12:16:40.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.735013 25130 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: configured and running, proceeding with master startup.
12:16:40.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.754357 25152 catalog_manager.cc:1594] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:16:40.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.754666 25152 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:16:40.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.762307 25084 tablet.cc:2406] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:40.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.762399 25153 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:40.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.762984 25153 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.766597 24949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9f0dacf46154da49e1b17424889d74c" is_pre_election: true
12:16:40.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.767475 24949 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2495bcf05fe44f6686dcc3b4e10550ad in term 0.
12:16:40.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.767642 25153 leader_election.cc:290] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9f0dacf46154da49e1b17424889d74c (127.24.66.62:39483), ec9fd487c36d4ceca21c763b0f507afd (127.24.66.61:43045)
12:16:40.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.768893 25080 leader_election.cc:304] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2495bcf05fe44f6686dcc3b4e10550ad, e9f0dacf46154da49e1b17424889d74c; no voters: 
12:16:40.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.769838 25153 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:40.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.770589 25153 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:40.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.771275 25153 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 0 FOLLOWER]: Advancing to term 1
12:16:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.738572 24852 master_runner.cc:187] Error getting master registration for 127.24.66.61:43045: OK, instance_id { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" instance_seqno: 1783512998772165 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:16:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.783979 24852 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:16:40.785 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:40.786 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:40.786 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:40.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.786 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.786 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.786 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.786 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.787 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:40.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.789552 25153 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.791774 25153 leader_election.cc:290] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [CANDIDATE]: Term 1 election: Requested vote from peers e9f0dacf46154da49e1b17424889d74c (127.24.66.62:39483), ec9fd487c36d4ceca21c763b0f507afd (127.24.66.61:43045)
12:16:40.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.792456 24949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9f0dacf46154da49e1b17424889d74c"
12:16:40.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.792924 24949 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 0 FOLLOWER]: Advancing to term 1
12:16:40.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.803665 24949 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2495bcf05fe44f6686dcc3b4e10550ad in term 1.
12:16:40.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.807687 25165 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:16:40.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.810171 25080 leader_election.cc:304] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2495bcf05fe44f6686dcc3b4e10550ad, e9f0dacf46154da49e1b17424889d74c; no voters: 
12:16:40.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.811873 25153 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 1 FOLLOWER]: Leader election won for term 1
12:16:40.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.831058 25153 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [term 1 LEADER]: Becoming Leader. State: Replica: 2495bcf05fe44f6686dcc3b4e10550ad, State: Running, Role: LEADER
12:16:40.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.832317 25153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:40.837 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:40.837 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:40.837 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:40.837 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:40.837 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:40.837 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:40.837 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:40.837 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:40.837 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:40.837 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:40.837 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:40.837 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:40.838 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:40.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.847779 25166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2495bcf05fe44f6686dcc3b4e10550ad. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.848618 25166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: This master's current role is: LEADER
12:16:40.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.851298 25168 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:16:40.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.862118 25168 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:16:40.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.822268 25051 master_runner.cc:187] Error getting master registration for 127.24.66.61:43045: OK, instance_id { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" instance_seqno: 1783512998772165 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:16:40.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.875511 25051 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:16:40.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:40.897917 24928 tablet.cc:2406] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:40.913 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:40.914 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:40.914 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:40.914 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:40.914 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:40.914 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:40.914 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:40.914 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:40.914 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:40.916 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:40.916 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:40.916 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:40.916 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:40.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.915203 24949 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [term 1 FOLLOWER]: Refusing update from remote peer 2495bcf05fe44f6686dcc3b4e10550ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:40.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.917852 25166 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:40.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.936818 25141 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2495bcf05fe44f6686dcc3b4e10550ad. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.937520 25141 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: This master's current role is: FOLLOWER
12:16:40.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.943344 25170 mvcc.cc:204] Tried to move back new op lower bound from 7305269251687055360 to 7305269251423113216. Current Snapshot: MvccSnapshot[applied={T|T < 7305269251687055360}]
12:16:40.946 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:40.946 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:40.946 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:40.946 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.946 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.946 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:40.946 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.946 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.946 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:40.947 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.947 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.947 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:40.947 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:40.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.960402 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.961138 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: This master's current role is: LEADER
12:16:40.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.963696 25168 catalog_manager.cc:1383] Generated new cluster ID: 5f432f4f8a4140b4af30034c94d4359e
12:16:40.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.963948 25168 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:16:40.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:40.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.959899 25141 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:40.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.971488 25141 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c [sys.catalog]: This master's current role is: FOLLOWER
12:16:40.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:40.977015 25171 mvcc.cc:204] Tried to move back new op lower bound from 7305269251687055360 to 7305269251423113216. Current Snapshot: MvccSnapshot[applied={T|T < 7305269251687055360 or (T in {7305269251687055360})}]
12:16:41.002 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 62 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513001002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:41.016 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 62 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:16:41.018 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 62 as completed for source Source: KuduSource.
12:16:41.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.021862 25168 catalog_manager.cc:1406] Generated new certificate authority record
12:16:41.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.025020 25168 catalog_manager.cc:1540] Loading token signing keys...
12:16:41.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.055433 25168 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad: Generated new TSK 0
12:16:41.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.056959 25168 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:16:41.073 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:41.073 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:41.073 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:41.074 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:41.074 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:41.074 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:41.074 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:41.074 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:41.074 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:41.074 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:41.074 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:41.074 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:41.075 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:41.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.089476 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:41.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/logs
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data/info.pb
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.1:0
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.1
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.1
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:41.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:41.126 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:41.126 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:41.126 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:41.127 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.127 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.127 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.127 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.127 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.127 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.127 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.127 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.127 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:41.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.173332 25049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } attempt: 7
12:16:41.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.236515 25049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: Bootstrap starting.
12:16:41.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.263629 25049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: Neither blocks nor log segments found. Creating new log.
12:16:41.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.269400 25049 log.cc:826] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: Log is configured to *not* fsync() on all Append() calls
12:16:41.274 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:41.274 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:41.274 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:41.274 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.274 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.274 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.274 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.274 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.274 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.275 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.275 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.275 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.275 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:41.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.297019 25049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: No bootstrap required, opened a new log
12:16:41.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.372175 25049 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:41.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.372980 25049 raft_consensus.cc:385] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:41.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.376304 25049 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9fd487c36d4ceca21c763b0f507afd, State: Initialized, Role: FOLLOWER
12:16:41.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.377272 25049 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } }
12:16:41.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.381700 25179 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:41.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.384914 25179 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: This master's current role is: FOLLOWER
12:16:41.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.387921 25049 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: configured and running, proceeding with master startup.
12:16:41.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.388093 25023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec9fd487c36d4ceca21c763b0f507afd"
12:16:41.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.388888 25023 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 0 FOLLOWER]: Advancing to term 1
12:16:41.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.393345 25024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec9fd487c36d4ceca21c763b0f507afd" is_pre_election: true
12:16:41.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.412122 25023 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2495bcf05fe44f6686dcc3b4e10550ad in term 1.
12:16:41.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.414412 25022 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [term 1 FOLLOWER]: Refusing update from remote peer 2495bcf05fe44f6686dcc3b4e10550ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:41.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.430656 25153 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:41.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.491199 25179 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2495bcf05fe44f6686dcc3b4e10550ad. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:41.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.491948 25179 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: This master's current role is: FOLLOWER
12:16:41.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.499787 25187 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:41.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.501555 25187 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd [sys.catalog]: This master's current role is: FOLLOWER
12:16:41.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 63 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513001502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:41.513 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 63 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:16:41.515 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 63 as completed for source Source: KuduSource.
12:16:41.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.529781 25196 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
12:16:41.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.652 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:41.652 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:41.652 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:41.653 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.653 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.653 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:41.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:41.654 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.654 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.654 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:41.654 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:41.670 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:41.670 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:41.670 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:41.670 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.670 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.671 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.671 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.671 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.671 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.671 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.671 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:41.697 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:41.697 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:41.697 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:41.703 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.703 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.703 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:41.703 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.703 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:41.703 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.704 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.704 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:41.704 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:41.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.764272 25152 catalog_manager.cc:1295] Loaded cluster ID: 5f432f4f8a4140b4af30034c94d4359e
12:16:41.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.764777 25152 catalog_manager.cc:1588] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: loading cluster ID for follower catalog manager: success
12:16:41.770 [DEBUG - pool-394-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30016), Traces: [0ms] sending RPC to server master-127.21.36.190:33455, [7ms] received response from server master-127.21.36.190:33455: OK, deferred=null) with no deferred attached!
12:16:41.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.780387 25152 catalog_manager.cc:1610] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: acquiring CA information for follower catalog manager: success
12:16:41.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.795686 25152 catalog_manager.cc:1638] T 00000000000000000000000000000000 P e9f0dacf46154da49e1b17424889d74c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:16:41.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:41.862159 25175 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:41.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:41.862775 25175 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:41.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:41.863464 25175 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:41.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:41.920477 25175 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:41.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:41.921778 25175 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.66.1
12:16:41.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.942 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:41.943 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:41.943 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:41.943 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.943 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.943 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:41.944 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.944 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.944 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:41.944 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.944 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.944 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:41.944 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:41.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.954152 25153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f0dacf46154da49e1b17424889d74c" member_type: VOTER last_known_addr { host: "127.24.66.62" port: 39483 } } peers { permanent_uuid: "ec9fd487c36d4ceca21c763b0f507afd" member_type: VOTER last_known_addr { host: "127.24.66.61" port: 43045 } } peers { permanent_uuid: "2495bcf05fe44f6686dcc3b4e10550ad" member_type: VOTER last_known_addr { host: "127.24.66.60" port: 33469 } } }
12:16:41.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.955197 25153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2495bcf05fe44f6686dcc3b4e10550ad [sys.catalog]: This master's current role is: LEADER
12:16:41.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.982045 25175 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.1:0
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data/info.pb
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.1
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:41.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.1
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/logs
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:41.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:41.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.983923 25175 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:41.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:41.986407 25175 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:42.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 64 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513002002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:42.012 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 64 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=10 ms, finalizationTime=0 ms).
12:16:42.013 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 64 as completed for source Source: KuduSource.
12:16:42.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:42.030843 25206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:42.081 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:42.081 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:42.081 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:42.082 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:42.082 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:42.082 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:42.082 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:42.082 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:42.082 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:42.083 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:42.083 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:42.083 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:42.083 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:42.121 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:42.121 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:42.122 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:42.122 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.122 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.122 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.122 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.122 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.122 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.123 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.123 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.123 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.123 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:42.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.502 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 65 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513002502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:42.510 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 65 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=7 ms, finalizationTime=1 ms).
12:16:42.511 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 65 as completed for source Source: KuduSource.
12:16:42.534 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:42.534 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:42.534 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:42.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.535 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.535 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.535 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.535 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.535 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.535 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.535 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:42.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:42.550414 25196 catalog_manager.cc:1295] Loaded cluster ID: 5f432f4f8a4140b4af30034c94d4359e
12:16:42.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:42.553042 25196 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: loading cluster ID for follower catalog manager: success
12:16:42.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:42.590538 25196 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: acquiring CA information for follower catalog manager: success
12:16:42.614 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:42.614 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:42.614 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:42.615 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.615 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.615 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:42.615 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.615 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.615 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:42.615 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.615 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.615 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:42.616 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:42.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:42.638491 25196 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ec9fd487c36d4ceca21c763b0f507afd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:16:42.766 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:42.766 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:42.766 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:42.767 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:42.767 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:42.767 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:42.767 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:42.767 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:42.767 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:42.767 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:42.767 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:42.767 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:42.767 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:42.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.914 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:42.914 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:42.914 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:42.915 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:42.915 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:42.915 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:42.915 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:42.915 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:42.915 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:42.915 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:42.915 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:42.915 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:42.916 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:42.922 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:42.922 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:42.922 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:42.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:42.922 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:42.922 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:42.922 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:42.923 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:42.923 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:42.923 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:42.923 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:42.923 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:42.923 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:42.923 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:42.956 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:42.956 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:42.956 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:42.957 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.957 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.957 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:42.957 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.957 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.957 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:42.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.958 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:42.958 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:42.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 66 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513003002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:43.010 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 66 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:16:43.014 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 66 as completed for source Source: KuduSource.
12:16:43.113 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:43.113 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:43.113 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:43.113 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.113 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.114 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.114 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.114 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.114 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.114 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.114 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:43.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.265 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:43.265 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:43.265 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:43.266 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.266 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.266 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.267 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.267 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.267 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.267 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.267 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.267 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.267 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:43.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.323 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:43.323 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:43.323 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:43.323 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:43.323 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:43.324 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:43.324 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:43.324 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:43.324 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:43.324 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:43.324 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:43.324 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:43.325 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:43.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:43.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:43.443 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:43.444 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.444 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.444 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:43.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.444 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:43.445 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.445 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.445 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:43.445 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:43.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 67 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513003502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:43.511 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 67 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=9 ms, finalizationTime=0 ms).
12:16:43.513 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 67 as completed for source Source: KuduSource.
12:16:43.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.770 [DEBUG - pool-394-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30011), Traces: [0ms] sending RPC to server master-127.21.36.190:33455, [4ms] received response from server master-127.21.36.190:33455: OK, deferred=null) with no deferred attached!
12:16:43.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.922 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.950 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:43.950 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:43.950 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:43.950 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.951 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.951 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:43.951 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.951 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.951 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:43.951 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.951 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.951 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:43.951 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:43.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:43.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:43.429382 25205 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 25175
12:16:43.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:42.060868 25208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:43.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:43.989233 25175 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.934s	user 0.674s	sys 0.930s
12:16:43.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:43.992022 25175 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.937s	user 0.675s	sys 0.930s
12:16:44.003 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 68 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513004002 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:44.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.006809 25175 server_base.cc:1061] running on GCE node
12:16:44.009 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 68 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=6 ms, finalizationTime=1 ms).
12:16:44.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 68 as completed for source Source: KuduSource.
12:16:44.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:44.013630 25214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:44.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.015148 25175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:44.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.018076 25175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:44.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.019557 25175 hybrid_clock.cc:648] HybridClock initialized: now 1783513004019445 us; error 106 us; skew 500 ppm
12:16:44.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.020627 25175 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:44.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.037806 25175 webserver.cc:533] Webserver started at http://127.24.66.1:38347/ using document root <none> and password file <none>
12:16:44.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.039080 25175 fs_manager.cc:362] Metadata directory not provided
12:16:44.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.039348 25175 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:44.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.039857 25175 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:44.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.046227 25175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data/instance:
12:16:44.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53c6ea42ecac400180703835b5daafac"
12:16:44.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:44 on dist-test-slave-vcgh"
12:16:44.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.047683 25175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal/instance:
12:16:44.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53c6ea42ecac400180703835b5daafac"
12:16:44.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:44 on dist-test-slave-vcgh"
12:16:44.050 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:44.050 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:44.051 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:44.051 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:44.051 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:44.051 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:44.051 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:44.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:44.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:44.051 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:44.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:44.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:44.051 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:44.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.057123 25175 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.002s
12:16:44.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.063752 25219 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.064968 25175 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
12:16:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.065342 25175 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal
12:16:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "53c6ea42ecac400180703835b5daafac"
12:16:44.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:44 on dist-test-slave-vcgh"
12:16:44.066 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:44.066 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:44.066 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:44.066 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.066 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.066 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.067 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.067 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.067 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.067 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.065682 25175 fs_report.cc:389] FS layout report
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data/data
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:44.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:44.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:44.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:44.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:44.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.142359 25175 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:44.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.144309 25175 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:44.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.144884 25175 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:44.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.148475 25175 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:44.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.154523 25175 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:44.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.154803 25175 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:44.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.155102 25175 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:44.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.155320 25175 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:44.204 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:44.204 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:44.204 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:44.204 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.204 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.204 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:44.205 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:44.205 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.205 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.205 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:44.205 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:44.222 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:44.222 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:44.222 [DEBUG - pool-382-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:44.223 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:44.223 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:44.223 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:44.223 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:44.223 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:44.223 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:44.223 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:44.223 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:44.223 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:44.223 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:44.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.383 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:44.384 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:44.384 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:44.384 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:44.384 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:44.385 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:44.385 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:44.385 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:44.385 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:44.385 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:44.384 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:44.385 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:44.386 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:44.422 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:44.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:44.442 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:44.443 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:44.443 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:44.443 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:44.443 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:44.443 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:44.443 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:44.443 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:44.443 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:44.443 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:44.443 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:44.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.503 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 69 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513004502 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:44.510 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 69 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:16:44.512 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 69 as completed for source Source: KuduSource.
12:16:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.561010 25175 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.1:40341
12:16:44.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.561120 25332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.1:40341 every 8 connection(s)
12:16:44.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.564116 25175 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/data/info.pb
12:16:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.573485 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 25175
12:16:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.574070 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-0/wal/instance
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.610666 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/logs
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data/info.pb
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:44.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.2:0
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.2
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.2
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:44.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:44.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.624770 25334 heartbeater.cc:344] Connected to a master server at 127.24.66.61:43045
12:16:44.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.625414 25334 heartbeater.cc:461] Registering TS with master...
12:16:44.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.626976 25334 heartbeater.cc:507] Master 127.24.66.61:43045 requested a full tablet report, sending...
12:16:44.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.631857 25014 ts_manager.cc:194] Registered new tserver with Master: 53c6ea42ecac400180703835b5daafac (127.24.66.1:40341)
12:16:44.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.640309 25333 heartbeater.cc:344] Connected to a master server at 127.24.66.60:33469
12:16:44.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.640725 25333 heartbeater.cc:461] Registering TS with master...
12:16:44.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.641659 25333 heartbeater.cc:507] Master 127.24.66.60:33469 requested a full tablet report, sending...
12:16:44.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.645519 25095 ts_manager.cc:194] Registered new tserver with Master: 53c6ea42ecac400180703835b5daafac (127.24.66.1:40341)
12:16:44.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.648465 25095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.66.1:38781
12:16:44.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.654520 25335 heartbeater.cc:344] Connected to a master server at 127.24.66.62:39483
12:16:44.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.654887 25335 heartbeater.cc:461] Registering TS with master...
12:16:44.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.655550 25335 heartbeater.cc:507] Master 127.24.66.62:39483 requested a full tablet report, sending...
12:16:44.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:44.658545 24939 ts_manager.cc:194] Registered new tserver with Master: 53c6ea42ecac400180703835b5daafac (127.24.66.1:40341)
12:16:44.758 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:44.759 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:44.759 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:44.759 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:44.759 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:44.759 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:44.760 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:44.760 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:44.760 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:44.760 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:44.760 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:44.760 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:44.760 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:44.774 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:44.774 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:44.774 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:44.774 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:44.774 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:44.774 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:44.775 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:44.775 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:44.775 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:44.775 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:44.775 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:44.775 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:44.775 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:44.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:44.788568 24072 debug-util.cc:398] Leaking SignalData structure 0x7b080003e3c0 after lost signal to thread 24009
12:16:44.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:44.789601 24072 debug-util.cc:398] Leaking SignalData structure 0x7b0800058fa0 after lost signal to thread 24075
12:16:44.799 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.892 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:44.893 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:44.893 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:44.893 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:44.893 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:44.893 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:44.894 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:44.894 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:44.894 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:44.894 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:44.894 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:44.894 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:44.894 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:44.923 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:44.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.005 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 70 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513005001 for job 1ca37d58d1e10dcfad9f21d692b10dbc.
12:16:45.014 [INFO - jobmanager-io-thread-3] (CheckpointCoordinator.java:1440) Completed checkpoint 70 for job 1ca37d58d1e10dcfad9f21d692b10dbc (1654 bytes, checkpointDuration=13 ms, finalizationTime=0 ms).
12:16:45.015 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 70 as completed for source Source: KuduSource.
12:16:45.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.015995 25343 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:45.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.016482 25343 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:45.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.016990 25343 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:45.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.056263 25343 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:45.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.057354 25343 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.66.2
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:45.103333 25343 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.2:0
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data/info.pb
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.2
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.2
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/logs
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:45.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:45.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:45.105871 25343 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:45.107 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:45.107 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:45.107 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:45.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.108 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.108 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.108 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:45.108026 25343 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:45.108 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.108 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.108 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.108 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:45.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.121524 25350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:45.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.153 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:45.153 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:45.153 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:45.154 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:45.154 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:45.154 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:45.154 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:45.154 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:45.154 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:45.155 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:45.155 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:45.155 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:45.155 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:45.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:45.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:45.183 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:45.183 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.183 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.183 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.183 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.184 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.184 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.184 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.184 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.184 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.184 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:45.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.310 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.190:33455(127.21.36.190:33455)] connecting to peer
12:16:45.311 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.189:35221(127.21.36.189:35221)] connecting to peer
12:16:45.311 [DEBUG - pool-440-thread-1] (Connection.java:748) [peer master-127.21.36.188:41809(127.21.36.188:41809)] connecting to peer
12:16:45.311 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:45.311 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.36.190:33455(127.21.36.190:33455)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:45.311 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.190:33455: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455
12:16:45.312 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:45.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.36.189:35221(127.21.36.189:35221)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:45.312 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.189:35221: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221
12:16:45.312 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:45.312 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.36.188:41809(127.21.36.188:41809)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:45.312 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.36.188:41809: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
12:16:45.312 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809; will retry
12:16:45.313 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
12:16:45.314 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1523) Notify RPC ScanRequest(scannerId=null, state=OPENING, tablet=647c61a50b44498fa3eeefd2a9e9edf1, attempt=4, KuduRpc(method=Scan, tablet=647c61a50b44498fa3eeefd2a9e9edf1, attempt=4, TimeoutTracker(timeout=30000, elapsed=29545), Traces: [0ms] sending RPC to server 9e24ca086a1e4322ad294d640b08f369, [475ms] received response from server 9e24ca086a1e4322ad294d640b08f369: Network error: connection closed, [476ms] delaying RPC due to: Network error: connection closed, [480ms] sending RPC to server d04ef4271a25405d8f61303c957c20e0, [482ms] received response from server d04ef4271a25405d8f61303c957c20e0: Network error: Failed to connect to peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281): Connection refused: /127.21.36.129:45281, [482ms] delaying RPC due to: Network error: Failed to connect to peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281): Connection refused: /127.21.36.129:45281, [501ms] sending RPC to server 8d2020977b084d98bff57776c1af7fc9, [502ms] received response from server 8d2020977b084d98bff57776c1af7fc9: Network error: Failed to connect to peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613): Connection refused: /127.21.36.130:37613, [502ms] delaying RPC due to: Network error: Failed to connect to peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613): Connection refused: /127.21.36.130:37613, [520ms] refreshing cache from master, [520ms] Sub RPC GetTableLocations: refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [522ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [522ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [536ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [543ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [543ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [560ms] Sub RPC GetTableLocations: refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [566ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [567ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [584ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [584ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [600ms] Sub RPC GetTableLocations: refreshing cache from master, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [600ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [600ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [601ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [601ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [620ms] Sub RPC GetTableLocations: refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [622ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [640ms] Sub RPC GetTableLocations: refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [641ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [641ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [641ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [642ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [680ms] Sub RPC GetTableLocations: refreshing cache from master, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [681ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [681ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [681ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [681ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [721ms] Sub RPC GetTableLocations: refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [721ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [721ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [721ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [721ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [841ms] Sub RPC GetTableLocations: refreshing cache from master, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [841ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [841ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [842ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [842ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1080ms] Sub RPC GetTableLocations: refreshing cache from master, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1081ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1081ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1140ms] Sub RPC GetTableLocations: refreshing cache from master, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1141ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1141ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1141ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1142ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1380ms] Sub RPC GetTableLocations: refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1382ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1382ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [2460ms] Sub RPC GetTableLocations: refreshing cache from master, [2460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [2461ms] too many traces: truncated at 100 traces, deferred=Deferred@1310311737(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0))) after lookup exception
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.21.36.188:41809
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.315 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:686) Can not open scanner
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
	at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
	at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
	at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	... 35 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.21.36.188:41809
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.315 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduScanner.java:862) Scanner null closed on null
12:16:45.316 [ERROR - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:190) Received uncaught exception.
java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.21.36.188:41809
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer d04ef4271a25405d8f61303c957c20e0(127.21.36.129:45281)] disconnecting while in state TERMINATED
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.36.189:35221(127.21.36.189:35221)] disconnecting while in state TERMINATED
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.36.190:33455(127.21.36.190:33455)] disconnecting while in state TERMINATED
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.36.188:41809(127.21.36.188:41809)] disconnecting while in state TERMINATED
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 8d2020977b084d98bff57776c1af7fc9(127.21.36.130:37613)] disconnecting while in state TERMINATED
12:16:45.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 9e24ca086a1e4322ad294d640b08f369(127.21.36.131:43095)] disconnecting while in state TERMINATED
12:16:45.317 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:45.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.224.190:35543(127.21.224.190:35543)] disconnecting while in state TERMINATED
12:16:45.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.224.188:40821(127.21.224.188:40821)] disconnecting while in state TERMINATED
12:16:45.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 47c08d351c2d48108b4850a050167e82(127.21.224.129:35357)] disconnecting while in state TERMINATED
12:16:45.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.21.224.189:39039(127.21.224.189:39039)] disconnecting while in state TERMINATED
12:16:45.321 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2b5802e7d4c448dfb93dd1bfb573d384(127.21.224.131:37413)] disconnecting while in state TERMINATED
12:16:45.322 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:45.323 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-2
12:16:45.323 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:16:45.323 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-0
12:16:45.323 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-4
12:16:45.324 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 21 thread-local buffer(s) from thread: kudu-nio-0
12:16:45.324 [DEBUG - kudu-nio-4] (PoolThreadCache.java:218) Freed 4 thread-local buffer(s) from thread: kudu-nio-4
12:16:45.324 [DEBUG - kudu-nio-5] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-5
12:16:45.324 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 5 exited.
12:16:45.326 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-3
12:16:45.326 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:16:45.327 [WARN - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED with failure cause:
java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.21.36.188:41809
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.327 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:16:45.330 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:16:45.333 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED on 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: One or more fetchers have encountered exception
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager.checkErrors(SplitFetcherManager.java:333)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:228)
	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:190)
	at org.apache.kudu.replication.wrappedsource.StatelessKuduReaderWrapper.pollNext(StatelessKuduReaderWrapper.java:63)
	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:443)
	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:68)
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:579)
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:909)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:858)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.SerializedThrowable: java.lang.RuntimeException: SplitFetcher thread 5 received unexpected exception while polling the records
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:168)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:117)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableLocations, tablet=null, attempt=25, TimeoutTracker(timeout=29478, elapsed=29022), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [2ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [16ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [23ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.189:35221(127.21.36.189:35221)] unexpected exception from downstream on [id: 0xacd8df42, L:/127.0.0.1:55080 - R:/127.21.36.189:35221], [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [41ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [47ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [64ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [64ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: [peer master-127.21.36.188:41809(127.21.36.188:41809)] unexpected exception from downstream on [id: 0x3e358003, L:/127.0.0.1:58768 - R:/127.21.36.188:41809], [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [80ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [81ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [81ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [101ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [102ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [102ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [121ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [122ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [161ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [161ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [201ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [201ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [321ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [322ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [322ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [560ms] refreshing cache from master, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [560ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [561ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [561ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [621ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [622ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [861ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [862ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [862ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1940ms] refreshing cache from master, [1940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [1941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.190:33455: Network error: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.188:41809: Network error: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809, [1941ms] Sub RPC ConnectToMaster: received response from server master-127.21.36.189:35221: Network error: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [1942ms] delaying RPC due to: Service unavailable: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221, [5040ms] refreshing cache from master, [5040ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.190:33455, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.189:35221, [5041ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.36.188:41809, [5041ms] too many traces: truncated at 100 traces, deferred=Deferred@78477828(state=PENDING, result=null, callback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574), errback=(continuation of Deferred@1559458976 after retry RPC after error@1687567901) -> (continuation of Deferred@993457855 after retry RPC after error@1411700359) -> (continuation of Deferred@322305751 after retry RPC after error@1174817914) -> (continuation of Deferred@1242155275 after retry RPC after error@954969635) -> (continuation of Deferred@76823727 after retry RPC after error@1887815131) -> (continuation of Deferred@1950358353 after retry RPC after error@289352012) -> (continuation of Deferred@887824000 after retry RPC after error@1780399835) -> (continuation of Deferred@510700122 after retry RPC after error@1995281809) -> (continuation of Deferred@438209234 after retry RPC after error@99157804) -> (continuation of Deferred@508583857 after retry RPC after error@76222711) -> (continuation of Deferred@1781351086 after retry RPC after error@665905312) -> (continuation of Deferred@989955632 after retry RPC after error@1733375247) -> (continuation of Deferred@1743332217 after retry RPC after error@1195127500) -> (continuation of Deferred@1891306525 after retry RPC after error@506242632) -> (continuation of Deferred@821079071 after retry RPC after error@385630879) -> (continuation of Deferred@1041203129 after retry RPC after error@1172996310) -> (continuation of Deferred@1884249120 after retry RPC after error@72552460) -> (continuation of Deferred@1105483144 after retry RPC after error@1352237394) -> (continuation of Deferred@1522362685 after retry RPC after error@1190314262) -> (continuation of Deferred@635012181 after retry RPC after error@961942189) -> (continuation of Deferred@135491643 after retry RPC after error@1488583262) -> (continuation of Deferred@824911408 after retry RPC after error@954309058) -> (continuation of Deferred@736142413 after retry RPC after error@1008521317) -> (continuation of Deferred@1416522608 after retry RPC after error@1618331574)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduScanner.nextRows(KuduScanner.java:81)
	at org.apache.flink.connector.kudu.source.reader.KuduSourceSplitReader.fetch(KuduSourceSplitReader.java:68)
	at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
	at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:165)
	... 6 more
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.21.36.190:33455,127.21.36.189:35221,127.21.36.188:41809) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.190:33455(127.21.36.190:33455): Connection refused: /127.21.36.190:33455,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.189:35221(127.21.36.189:35221): Connection refused: /127.21.36.189:35221,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.36.188:41809(127.21.36.188:41809): Connection refused: /127.21.36.188:41809
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.21.36.188:41809
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.334 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:16:45.334 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc) switched from state RUNNING to RESTARTING.
12:16:45.335 [WARN - flink-pekko.actor.default-dispatcher-8] (TaskManagerLocation.java:276) No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted.
12:16:45.335 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 1ca37d58d1e10dcfad9f21d692b10dbc: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:45.336 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:16:45.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:45.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:45.403 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:45.403 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.403 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.403 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.404 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.404 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.404 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.404 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.404 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.404 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.404 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:45.422 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:45.422 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:45.422 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:45.424 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.424 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.424 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.425 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.425 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.425 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.425 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.425 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.425 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.425 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:45.453 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:45.454 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:45.454 [DEBUG - pool-452-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:45.454 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:45.454 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:45.454 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:45.455 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:45.455 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:45.455 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:45.455 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:45.455 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:45.455 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:45.455 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:45.456 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27162), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [23ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [41ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [221ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [781ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [4440ms] refreshing cache from master, [4440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4441ms] too many traces: truncated at 100 traces, deferred=Deferred@1265554364(state=PENDING, result=null, callback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240), errback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240)))
12:16:45.457 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:16:45.457 [WARN - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27162), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [23ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [41ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [221ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [781ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [4440ms] refreshing cache from master, [4440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4441ms] too many traces: truncated at 100 traces, deferred=Deferred@1265554364(state=PENDING, result=null, callback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240), errback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.457 [INFO - Source: KuduSource -> Sink: Writer (1/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3).
12:16:45.459 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#3 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
12:16:45.461 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=27162), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [22ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [23ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [41ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [62ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [221ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [461ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [461ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [781ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [781ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1122ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1122ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] refreshing cache from master, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2681ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2681ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [4440ms] refreshing cache from master, [4440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [4441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4441ms] too many traces: truncated at 100 traces, deferred=Deferred@1265554364(state=PENDING, result=null, callback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240), errback=(continuation of Deferred@71720018 after retry RPC after error@1185543663) -> (continuation of Deferred@2048743300 after retry RPC after error@1205049416) -> (continuation of Deferred@1908537388 after retry RPC after error@2026794358) -> (continuation of Deferred@1761584284 after retry RPC after error@859136019) -> (continuation of Deferred@1305210561 after retry RPC after error@1189453779) -> (continuation of Deferred@1403721943 after retry RPC after error@1267130185) -> (continuation of Deferred@1495895326 after retry RPC after error@869833455) -> (continuation of Deferred@951992803 after retry RPC after error@1170193706) -> (continuation of Deferred@1357617662 after retry RPC after error@663973614) -> (continuation of Deferred@1835569830 after retry RPC after error@1426470092) -> (continuation of Deferred@1504601083 after retry RPC after error@1702269502) -> (continuation of Deferred@1277346196 after retry RPC after error@677784712) -> (continuation of Deferred@50144196 after retry RPC after error@1405855431) -> (continuation of Deferred@155185995 after retry RPC after error@270834824) -> (continuation of Deferred@2066513483 after retry RPC after error@1969160823) -> (continuation of Deferred@51118652 after retry RPC after error@939003401) -> (continuation of Deferred@801038491 after retry RPC after error@578753441) -> (continuation of Deferred@1099036720 after retry RPC after error@914243151) -> (continuation of Deferred@1847376419 after retry RPC after error@883187290) -> (continuation of Deferred@2057990278 after retry RPC after error@1038198234) -> (continuation of Deferred@908578279 after retry RPC after error@552014839) -> (continuation of Deferred@157313325 after retry RPC after error@966775470) -> (continuation of Deferred@836724879 after retry RPC after error@692043240)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.252:38447
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:45.462 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#3) of source Source: KuduSource.
12:16:45.462 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:45.463 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_3.
12:16:45.463 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:16:45.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.549 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:45.550 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:45.550 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:45.550 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.550 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.550 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.550 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.550 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.550 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.551 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.551 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.551 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.551 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:45.573 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:45.573 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:45.573 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:45.573 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.574 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.574 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.574 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.574 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.574 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.574 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.574 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.574 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.574 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:45.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.642 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:45.643 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:45.643 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:45.643 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.643 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.643 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:45.643 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.643 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.643 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:45.644 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.644 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.644 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:45.644 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:45.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:45.654531 25333 heartbeater.cc:499] Master 127.24.66.60:33469 was elected leader, sending a full tablet report...
12:16:45.771 [DEBUG - pool-394-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=loopLocateTable, tablet=null, attempt=0, TimeoutTracker(timeout=30000, elapsed=30017), Traces: [0ms] sending RPC to server master-127.21.36.190:33455, [5ms] received response from server master-127.21.36.190:33455: OK, deferred=null) with no deferred attached!
12:16:45.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.886 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:45.886 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:45.886 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:45.887 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.887 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.887 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:45.888 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.888 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.888 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:45.888 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.888 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.888 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:45.888 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:45.892 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:45.892 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:45.893 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:45.893 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.893 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.893 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.893 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.893 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.893 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.894 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.894 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.894 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.894 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:45.895 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:45.895 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:45.895 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:45.896 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.896 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.896 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.896 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.896 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.896 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.896 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.896 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.896 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.896 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:45.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:45.993 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:45.993 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:45.994 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:45.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.994 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.994 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.994 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:45.994 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.994 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:45.994 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.994 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.994 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:45.994 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:46.130 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:46.130 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:46.130 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:46.131 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.131 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.131 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.131 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.131 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.131 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.131 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.131 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.131 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:46.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.303 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:46.303 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:46.303 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:46.303 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:46.303 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:46.303 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:46.304 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:46.304 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:46.304 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:46.304 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:46.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:46.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:46.304 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:46.347 [INFO - flink-pekko.actor.default-dispatcher-9] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (1ca37d58d1e10dcfad9f21d692b10dbc) switched from state RESTARTING to RUNNING.
12:16:46.347 [INFO - flink-pekko.actor.default-dispatcher-9] (CheckpointCoordinator.java:1805) Restoring job 1ca37d58d1e10dcfad9f21d692b10dbc from Checkpoint 70 @ 1783513005001 for 1ca37d58d1e10dcfad9f21d692b10dbc located at file:/tmp/junit14007088989382054048/checkpoints/1ca37d58d1e10dcfad9f21d692b10dbc/chk-70.
12:16:46.348 [INFO - flink-pekko.actor.default-dispatcher-9] (MasterHooks.java:201) No master state to restore
12:16:46.348 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 70 for source Source: KuduSource to checkpoint.
12:16:46.348 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to SCHEDULED.
12:16:46.355 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING.
12:16:46.355 [INFO - flink-pekko.actor.default-dispatcher-9] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #1) with attempt id 6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 44ac3fbb-4e35-4d22-8fdf-4a7c8a86c4ae @ 127.0.0.1 (dataPort=-1) with allocation id 4e10753ea3e92c7d4ed2a7070c819ee7
12:16:46.356 [INFO - flink-pekko.actor.default-dispatcher-9] (FineGrainedSlotManager.java:324) Received resource requirements from job 1ca37d58d1e10dcfad9f21d692b10dbc: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:46.356 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 4e10753ea3e92c7d4ed2a7070c819ee7.
12:16:46.357 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#1 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 4e10753ea3e92c7d4ed2a7070c819ee7.
12:16:46.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
12:16:46.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#1 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
12:16:46.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7f3e5f23
12:16:46.361 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:46.362 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit14007088989382054048/checkpoints")
12:16:46.362 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#1 (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:16:46.362 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (6b58d362473e582c2c5e5deb16d39e3b_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
12:16:46.364 [INFO - Source: KuduSource -> Sink: Writer (1/4)#1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@a9c5891
12:16:46.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:46.372 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.382 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.383 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.383 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.384 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.385 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.386 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.386 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.386 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.388 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.388 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.388 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.388 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.392 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.396 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.396 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.396 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.396 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.398 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.399 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.399 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.399 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.401 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.401 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.401 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.401 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.413 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.416 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.417 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.417 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.417 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.419 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.419 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.419 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.419 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.420 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.420 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.420 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.420 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.432 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.433 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.433 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.433 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.433 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.433 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.433 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.433 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.433 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.434 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.434 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.434 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.434 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.433 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:46.434 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:46.434 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:46.434 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:46.434 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:46.434 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:46.434 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:46.434 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:46.435 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:46.434 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:46.435 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:46.435 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:46.435 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:46.453 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.453 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.453 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.453 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.454 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.454 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.454 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.454 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.454 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.454 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.454 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.454 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.454 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.454 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.472 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.473 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.473 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.473 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.473 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.473 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.473 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.474 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.474 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.474 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.474 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.474 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.474 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.482 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:46.483 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:46.483 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:46.483 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.483 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.483 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.483 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.483 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.483 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.484 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.484 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.484 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.484 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:46.552 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.553 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.553 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.553 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.553 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.553 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.553 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.554 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.602 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:46.603 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:46.603 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:46.603 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.603 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.603 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:46.604 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.604 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.604 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:46.604 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.604 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.604 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:46.604 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:46.632 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.632 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.632 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.633 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.633 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.633 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.633 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.633 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.633 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.634 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.634 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.634 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.634 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:46.528559 25349 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 25343
12:16:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:45.124949 25351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:46.829864 25343 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.706s	user 0.592s	sys 0.945s
12:16:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:46.830214 25343 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.706s	user 0.592s	sys 0.945s
12:16:46.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:46.832231 25353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:46.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:46.838711 25352 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1714 milliseconds
12:16:46.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.838721 25343 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:46.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.840231 25343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:46.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.843413 25343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:46.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.844969 25343 hybrid_clock.cc:648] HybridClock initialized: now 1783513006844853 us; error 46 us; skew 500 ppm
12:16:46.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.846343 25343 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:46.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.854466 25343 webserver.cc:533] Webserver started at http://127.24.66.2:40879/ using document root <none> and password file <none>
12:16:46.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.855675 25343 fs_manager.cc:362] Metadata directory not provided
12:16:46.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.855929 25343 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:46.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.856464 25343 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:46.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.862963 25343 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data/instance:
12:16:46.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d447ba7a00542faa1c4377230a6debb"
12:16:46.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:46 on dist-test-slave-vcgh"
12:16:46.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.864081 25343 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal/instance:
12:16:46.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d447ba7a00542faa1c4377230a6debb"
12:16:46.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:46 on dist-test-slave-vcgh"
12:16:46.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:46.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:46.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:46.866 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.866 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.866 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.866 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.866 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.866 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.866 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.866 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.866 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:46.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.872382 25343 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
12:16:46.873 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:46.873 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:46.873 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:46.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.873 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.873 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.873 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.873 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:46.873 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:46.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.874 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:46.874 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:46.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.878121 25374 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:46.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.879261 25343 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
12:16:46.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.879523 25343 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal
12:16:46.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d447ba7a00542faa1c4377230a6debb"
12:16:46.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:46 on dist-test-slave-vcgh"
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.879869 25343 fs_report.cc:389] FS layout report
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data/data
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:46.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:46.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.928066 25343 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:46.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.929601 25343 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:46.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.930013 25343 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:46.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.932624 25343 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.936992 25343 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.937207 25343 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.937454 25343 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:46.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:46.937626 25343 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:46.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.964 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:46.965 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:46.965 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:46.965 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.965 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.965 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:46.965 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:46.966 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.966 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.966 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:46.966 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:46.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:46.981 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:46.981 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:46.981 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:46.982 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:46.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:46.982 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:46.982 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:46.982 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:46.982 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:46.982 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:46.982 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:46.982 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:46.982 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:47.013 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:47.013 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:47.013 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:47.014 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.014 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.014 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.014 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.014 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.014 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.014 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.014 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.014 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.014 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:47.034 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (8680f415d5d255088cd51ec1e8014bb4) switched from state RESTARTING to RUNNING.
12:16:47.035 [INFO - flink-pekko.actor.default-dispatcher-6] (CheckpointCoordinator.java:1805) Restoring job 8680f415d5d255088cd51ec1e8014bb4 from Checkpoint 71 @ 1783512834428 for 8680f415d5d255088cd51ec1e8014bb4 located at file:/tmp/junit9607081754023219410/checkpoints/8680f415d5d255088cd51ec1e8014bb4/chk-71.
12:16:47.036 [INFO - flink-pekko.actor.default-dispatcher-6] (MasterHooks.java:201) No master state to restore
12:16:47.036 [INFO - flink-pekko.actor.default-dispatcher-6] (RecreateOnResetOperatorCoordinator.java:128) Resetting coordinator to checkpoint.
12:16:47.041 [INFO - Thread-69] (SourceCoordinator.java:290) Closing SourceCoordinator for source Source: KuduSource.
12:16:47.041 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to SCHEDULED.
12:16:47.041 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.12.238.252:39469(127.12.238.252:39469)] disconnecting while in state TERMINATED
12:16:47.041 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.12.238.254:35497(127.12.238.254:35497)] disconnecting while in state TERMINATED
12:16:47.041 [DEBUG - Thread-69] (Connection.java:575) [peer master-127.12.238.253:35475(127.12.238.253:35475)] disconnecting while in state TERMINATED
12:16:47.041 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:47.041 [DEBUG - Thread-69] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:47.041 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from SCHEDULED to DEPLOYING.
12:16:47.042 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #7) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb
12:16:47.042 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to SCHEDULED.
12:16:47.042 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskSlotTableImpl.java:391) Activate slot 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:16:47.043 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:47.043 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7), deploy into slot with allocation id 7fc68cc9e14a520e7d6ce73a3865b2fb.
12:16:47.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from CREATED to DEPLOYING.
12:16:47.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) [DEPLOYING].
12:16:47.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7b8d9b36
12:16:47.044 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:47.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:47.045 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
12:16:47.045 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from SCHEDULED to DEPLOYING.
12:16:47.045 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #7) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id 961f0346c9a412a84fbfc0b9a06661b0
12:16:47.045 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to SCHEDULED.
12:16:47.045 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 961f0346c9a412a84fbfc0b9a06661b0.
12:16:47.046 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:47.046 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7), deploy into slot with allocation id 961f0346c9a412a84fbfc0b9a06661b0.
12:16:47.046 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from SCHEDULED to DEPLOYING.
12:16:47.046 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #6) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id de5ed38ba08a07738380230c918cff9a
12:16:47.046 [INFO - Thread-69] (SourceCoordinator.java:295) Source coordinator for source Source: KuduSource closed.
12:16:47.047 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to SCHEDULED.
12:16:47.047 [INFO - Thread-69] (SourceCoordinator.java:449) Restoring SplitEnumerator of source Source: KuduSource from checkpoint.
12:16:47.047 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from SCHEDULED to DEPLOYING.
12:16:47.047 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #7) with attempt id 267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to e8ac90f3-d004-4934-a36d-11d5c4497d29 @ 127.0.0.1 (dataPort=-1) with allocation id cea21aacffbe33a581aa8d6918420aeb
12:16:47.047 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from DEPLOYING to INITIALIZING.
12:16:47.048 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 8680f415d5d255088cd51ec1e8014bb4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:47.048 [DEBUG - Thread-69] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:47.049 [INFO - Thread-69] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:47.051 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6880e607
12:16:47.052 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot de5ed38ba08a07738380230c918cff9a.
12:16:47.053 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6), deploy into slot with allocation id de5ed38ba08a07738380230c918cff9a.
12:16:47.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from CREATED to DEPLOYING.
12:16:47.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) [DEPLOYING].
12:16:47.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@47954ee5
12:16:47.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:47.054 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:47.055 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
12:16:47.055 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from DEPLOYING to INITIALIZING.
12:16:47.055 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:47.057 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cea21aacffbe33a581aa8d6918420aeb.
12:16:47.057 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from CREATED to DEPLOYING.
12:16:47.058 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) [DEPLOYING].
12:16:47.058 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7), deploy into slot with allocation id cea21aacffbe33a581aa8d6918420aeb.
12:16:47.059 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@559f6823
12:16:47.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3ce6bccc
12:16:47.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:47.059 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:47.060 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#6 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
12:16:47.060 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_2_6) switched from DEPLOYING to INITIALIZING.
12:16:47.061 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:47.063 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:47.064 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:47.064 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:47.064 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.064 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.064 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.064 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.064 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.064 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.064 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.064 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:47.065 [INFO - Source: KuduSource -> Sink: Writer (3/4)#6] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3121aea7
12:16:47.066 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:47.068 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.071 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CREATED to DEPLOYING.
12:16:47.071 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) [DEPLOYING].
12:16:47.071 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6ea35e4c
12:16:47.071 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:47.072 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit9607081754023219410/checkpoints")
12:16:47.072 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
12:16:47.072 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (267c32c239125ae072b47a4c03776bf2_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from DEPLOYING to INITIALIZING.
12:16:47.074 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1e48b8fd
12:16:47.076 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:47.076 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.077 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.078 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'lastEndTimestamp'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:47.078 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:47.078 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'unassignedCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:47.078 [WARN - SourceCoordinator-Source: KuduSource] (AbstractMetricGroup.java:445) Name collision: Group already contains a Metric with the name 'pendingRemovalCount'. Metric will not be reported.[localhost, jobmanager, Flink Streaming Job, Source: KuduSource -> Sink: Writer, coordinator, enumerator]
12:16:47.083 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.095 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#7] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.096 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.096 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.096 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.097 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.097 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.097 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.097 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#7] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.099 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.099 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.100 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.100 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.101 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.101 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.101 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.102 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#6] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.102 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.103 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.103 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.103 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.103 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.104 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.105 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.105 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.105 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.105 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#7] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.105 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.105 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.105 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.106 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.106 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.106 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.106 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.106 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.107 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.107 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.107 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.107 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.107 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.107 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.107 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.107 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.107 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.107 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.107 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.108 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.109 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.109 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.110 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.110 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.110 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.110 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.113 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.113 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.113 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.113 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.117 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.117 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.117 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.118 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.119 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.119 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.119 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.119 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.119 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.119 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.119 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.119 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.119 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.119 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.119 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.119 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.120 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.120 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.120 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.120 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.120 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.120 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.120 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.120 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.120 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.120 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.120 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.121 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.121 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.121 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.121 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.121 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.121 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.126 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.127 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.127 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.127 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.127 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.127 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.128 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.128 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.128 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.128 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.128 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.128 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.128 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.129 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.129 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.129 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.129 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.129 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.129 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.129 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.130 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.130 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.130 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.130 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.130 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.130 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.137 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.137 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.137 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.137 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.137 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.137 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.138 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.138 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.138 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.138 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.138 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.138 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.138 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.138 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.138 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.139 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.139 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.139 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.139 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.139 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.139 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.139 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.139 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.139 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.139 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.139 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.140 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.145 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.145 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.145 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.145 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.145 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.146 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.146 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.146 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.146 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.146 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.147 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.147 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.148 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.147 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.148 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.148 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.148 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.148 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.148 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.148 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.148 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.148 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.148 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.148 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.149 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.149 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.149 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.149 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.149 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.149 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.149 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.149 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.149 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.149 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.149 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.157 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.157 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.157 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.157 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.157 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.157 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.157 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.157 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.157 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.157 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.158 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.158 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.158 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.158 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.158 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.158 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.159 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.160 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.160 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.160 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.160 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.160 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.160 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.160 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.160 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.160 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.160 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.160 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.160 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.166733 25343 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.2:46049
12:16:47.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.166906 25540 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.2:46049 every 8 connection(s)
12:16:47.167 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.167 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.167 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.167 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.167 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.167 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.167 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.167 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.167 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.168 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.168 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.168 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.168 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.169 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.169 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.169 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.169 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.169 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.169 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.169 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.169 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.169 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.169 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.169 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.169 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.169 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.169581 25343 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/data/info.pb
12:16:47.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.175750 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 25343
12:16:47.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.176235 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-1/wal/instance
12:16:47.177 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.177 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.177 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.177 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.177 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.177 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.177 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.177 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.177 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.178 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.178 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.178 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.178 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.178 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.178 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.178 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.178 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.178 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.178 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.179 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.178 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.178 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.180 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.180 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.180 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.180 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.180 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.180 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.180 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.180 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.181 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.181 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.181 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.181 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.181 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.181 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.181 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.186 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.187 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.187 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.187 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.187 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.187 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.187 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.187 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.187 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.187 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.188 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.188 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.188 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.188 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.188 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.188 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.189 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.189 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.189 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.189 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.189 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.189 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.189 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.189 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.189 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.197 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.197 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.197 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.198 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.198 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.198 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.198 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.198 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.198 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.198 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.198 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.198 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.198 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.198 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.198 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.198 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.199 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.199 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.199 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.199 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.199 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.199 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.199 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.199 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.199 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.199 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.199 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.199 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.199 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.200 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.200 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.200 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.200 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.200 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.200 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.200 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.201 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.201 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.201 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.201818 24840 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/logs
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data/info.pb
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.3:0
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.3
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.3
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:16:47.217 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.218 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.218 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.218 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.218 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.218 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.218 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.218 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.218 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.219 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.219 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.219 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.219 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.223172 25542 heartbeater.cc:344] Connected to a master server at 127.24.66.61:43045
12:16:47.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.223750 25542 heartbeater.cc:461] Registering TS with master...
12:16:47.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.225265 25542 heartbeater.cc:507] Master 127.24.66.61:43045 requested a full tablet report, sending...
12:16:47.226 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.226 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.226 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.227 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.227 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.227 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.227 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.227 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.227 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.227 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.227 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.227 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.227 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.229267 25014 ts_manager.cc:194] Registered new tserver with Master: 1d447ba7a00542faa1c4377230a6debb (127.24.66.2:46049)
12:16:47.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.234563 25543 heartbeater.cc:344] Connected to a master server at 127.24.66.62:39483
12:16:47.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.234941 25543 heartbeater.cc:461] Registering TS with master...
12:16:47.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.236008 25541 heartbeater.cc:344] Connected to a master server at 127.24.66.60:33469
12:16:47.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.235819 25543 heartbeater.cc:507] Master 127.24.66.62:39483 requested a full tablet report, sending...
12:16:47.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.236519 25541 heartbeater.cc:461] Registering TS with master...
12:16:47.237 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.237 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.237 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.237 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.237 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.237 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.237 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.237 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.237 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.237 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.238 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.238 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.238 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.237438 25541 heartbeater.cc:507] Master 127.24.66.60:33469 requested a full tablet report, sending...
12:16:47.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.239800 24939 ts_manager.cc:194] Registered new tserver with Master: 1d447ba7a00542faa1c4377230a6debb (127.24.66.2:46049)
12:16:47.240 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.240 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.240 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.240 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.240 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.240 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.240 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.240 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.241 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.241 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.241 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.241 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.241 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.241325 25095 ts_manager.cc:194] Registered new tserver with Master: 1d447ba7a00542faa1c4377230a6debb (127.24.66.2:46049)
12:16:47.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.242707 25095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.66.2:56901
12:16:47.249 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.249 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.249 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.249 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.249 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.249 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.250 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.249 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.250 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.250 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.250 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.250 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.250 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.287 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.287 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.287 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.287 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.287 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.287 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.287 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.287 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.288 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.288 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.288 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.288 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.288 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.326 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.327 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.327 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.327 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.327 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.327 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.327 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.327 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.327 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.327 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.327 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.327 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.327 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.340 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.340 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.340 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.340 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.340 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.340 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.340 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.340 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.340 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.341 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.341 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.341 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.341 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.357 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.357 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.357 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.357 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.357 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.358 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.357 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.358 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.358 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.358 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.358 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.357 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.358 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.358 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.359 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.359 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.360 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.360 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.360 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.360 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.360 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.360 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.360 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.360 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.360 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.360 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.360 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.369 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.369 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.369 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.369 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.369 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.369 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.369 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.369 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.369 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.369 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.369 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.369 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.369 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.376 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.377 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.377 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.377 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.377 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.377 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.377 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.377 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.377 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.377 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.377 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.377 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.377 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.408 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.409 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.409 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.409 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.409 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.409 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.409 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.409 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.409 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.409 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.410 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.413 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:47.413 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:47.414 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:47.414 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:47.414 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:47.414 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:47.414 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:47.414 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:47.414 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:47.414 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:47.414 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:47.414 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:47.414 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:47.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.450 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:47.450 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:47.450 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:47.450 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.450 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.450 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.450 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.450 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.450 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.450 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.450 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.450 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.451 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:47.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.507 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:47.507 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:47.507 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:47.507 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.507 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.507 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.507 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.508 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.508 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.508 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:47.508 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:47.508 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:47.508 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:47.545 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:47.546 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:47.546 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:47.546 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.546 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.546 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.546 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.546 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.546 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.546 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.546 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.546 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.546 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:47.549 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.549 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.549 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.549 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.549 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.549 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.549 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.549 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.549 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.549 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.549 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.549 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.549 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.558 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.558 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.558 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.558 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.558 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.558 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.559 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.559 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.559 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.559 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.559 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.559 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.559 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.559923 25551 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:16:47.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.560585 25551 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:16:47.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.561322 25551 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:16:47.577 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.577 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.577 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.577 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.577 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.577 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.577 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.577 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.577 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.577 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.589 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.589 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.590 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.590 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.590 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.590 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.590 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.590 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.590 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.590 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.590 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.590 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.590 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.618180 25551 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:16:47.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.619287 25551 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.66.3
12:16:47.638 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.638 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.638 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.638 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.639 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.639 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.639 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.639 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.639 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.639 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.639 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.639 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.639 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.659682 25551 tablet_server_runner.cc:78] Tablet server non-default flags:
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.66.20:45889
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.66.3:0
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data/info.pb
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.66.3
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.66.62:39483,127.24.66.61:43045,127.24.66.60:33469
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.66.3
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/logs
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:16:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:16:47.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.661000 25551 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:16:47.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:47.662583 25551 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:16:47.663 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:47.663 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:47.663 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:47.663 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:47.663 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:47.663 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:47.664 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:47.664 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:47.664 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:47.664 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:47.664 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:47.664 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:47.664 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:47.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.675877 25558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:47.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.800 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.800 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.800 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.800 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.801 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.801 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.801 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.801 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.801 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.801 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.802 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.817 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:47.817 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:47.817 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:47.817 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.817 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.817 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:47.818 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.818 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.818 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:47.818 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.818 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.818 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:47.818 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:47.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:47.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:47.866 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:47.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.867 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.867 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.867 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.867 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.867 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.867 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.867 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:47.933 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:47.933 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:47.933 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:47.934 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.934 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.934 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:47.935 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.935 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.935 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:47.935 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.935 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.935 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:47.935 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:47.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:47.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:47.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:47.985 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:47.986 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.986 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:47.987 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.987 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.987 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:47.987 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.987 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.987 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:47.987 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:48.007 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:48.007 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:48.007 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:48.008 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.008 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.008 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.008 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.008 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.009 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.009 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.009 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.009 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.009 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:48.097 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:48.098 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:48.098 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:48.098 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.098 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.098 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.099 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.099 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.099 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.099 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.099 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.099 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.099 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:48.100 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.120 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:48.120 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:48.120 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:48.121 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.121 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.121 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.121 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.121 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.121 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.122 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.122 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.122 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.122 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:48.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:48.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:48.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:48.159 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.159 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.159 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.159 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.159 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.160 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.160 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.160 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.160 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.160 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:48.167 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:48.167 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:48.167 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:48.168 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.168 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.168 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.168 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.168 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.168 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.168 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.168 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.169 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:48.190 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.191 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.191 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.191 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.191 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.191 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.192 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.192 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.192 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.192 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.192 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.192 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.192 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:48.245771 25541 heartbeater.cc:499] Master 127.24.66.60:33469 was elected leader, sending a full tablet report...
12:16:48.273 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:48.273 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:48.274 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:48.274 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:48.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:48.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:48.274 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:48.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:48.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:48.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:48.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:48.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:48.274 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:48.289 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.289 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.289 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.289 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.289 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.289 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.289 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.290 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.290 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.290 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.290 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.290 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.290 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.369 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.369 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.369 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.370 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.370 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.370 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.370 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.370 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.370 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.370 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.370 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.370 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.370 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.397 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:48.397 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:48.397 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:48.398 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:48.398 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:48.398 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:48.398 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:48.398 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:48.398 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:48.398 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:48.398 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:48.398 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:48.398 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:48.448 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:48.449 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:48.449 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:48.449 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.449 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.449 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.450 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.450 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.450 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.450 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.450 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.450 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.450 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:48.466 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:48.466 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:48.466 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:48.467 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.467 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.467 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:48.467 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.467 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.467 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:48.468 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.468 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.468 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:48.468 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:48.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.525 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:48.525 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:48.525 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:48.526 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.526 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.526 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.526 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.526 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.526 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.527 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.527 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.527 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.527 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:48.569 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.569 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.569 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.569 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.569 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.569 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.570 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.570 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.570 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.570 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.570 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.570 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.570 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:48.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:48.574 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:48.575 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:48.575 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:48.575 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:48.575 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:48.575 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:48.575 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:48.576 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:48.576 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:48.576 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:48.576 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:48.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.603 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.604 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.604 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.611 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.611 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.611 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.611 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.611 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.611 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.613 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:48.613 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:48.613 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:48.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:48.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:48.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:48.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:48.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:48.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:48.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:48.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:48.615 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:48.615 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:48.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.783 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:48.783 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:48.865 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:48.866 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.867 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.867 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:48.867 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.867 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.867 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:48.868 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.868 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.868 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:48.868 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:48.869 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.869 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:48.870 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:48.870 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:48.870 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.870 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:48.870 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.870 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.870 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:48.870 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.870 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.870 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:48.870 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:48.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:48.966 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:48.966 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:48.966 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:48.966 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.966 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.966 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.966 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.966 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:48.967 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:48.967 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.967 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.967 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:48.967 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:48.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.033 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:49.033 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:49.033 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:49.033 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:49.033 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:49.033 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:49.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:49.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:49.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:49.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:49.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:49.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:49.034 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:49.139 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.143 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.078342 25557 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 25551
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.128078 25557 kernel_stack_watchdog.cc:198] Thread 25551 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 399ms:
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:47.680961 25559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.129222 25551 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.453s	user 0.501s	sys 0.709s
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.129613 25551 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.454s	user 0.501s	sys 0.709s
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.130362 25561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:16:49.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.142879 25560 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1465 milliseconds
12:16:49.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.144080 25551 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:16:49.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.145854 25551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:16:49.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.157326 25551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:16:49.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.159687 25551 hybrid_clock.cc:648] HybridClock initialized: now 1783513009159642 us; error 48 us; skew 500 ppm
12:16:49.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.160983 25551 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:16:49.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.178754 25551 webserver.cc:533] Webserver started at http://127.24.66.3:34825/ using document root <none> and password file <none>
12:16:49.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.179989 25551 fs_manager.cc:362] Metadata directory not provided
12:16:49.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.180255 25551 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:16:49.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.180845 25551 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:16:49.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.187603 25551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data/instance:
12:16:49.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "60f38d7e54994965809690b5a8afb3b1"
12:16:49.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:49 on dist-test-slave-vcgh"
12:16:49.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.189096 25551 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal/instance:
12:16:49.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "60f38d7e54994965809690b5a8afb3b1"
12:16:49.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:49 on dist-test-slave-vcgh"
12:16:49.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.198356 25551 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
12:16:49.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.205917 25570 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:16:49.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.207158 25551 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.003s
12:16:49.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.207494 25551 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data,/tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal
12:16:49.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "60f38d7e54994965809690b5a8afb3b1"
12:16:49.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:16:49 on dist-test-slave-vcgh"
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.207918 25551 fs_report.cc:389] FS layout report
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data/data
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:16:49.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:16:49.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.288352 25551 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:16:49.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.289921 25551 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:16:49.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.290409 25551 kserver.cc:163] Server-wide thread pool size limit: 3276
12:16:49.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.293140 25551 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:16:49.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.297822 25551 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:16:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.298080 25551 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:16:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.298367 25551 ts_tablet_manager.cc:616] Registered 0 tablets
12:16:49.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.298573 25551 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:16:49.301 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:49.301 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:49.301 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:49.301 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:49.301 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:49.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:49.301 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:49.301 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:49.301 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:49.301 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:49.301 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:49.301 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:49.302 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:49.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:49.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:49.358 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:49.358 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:49.358 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:49.358 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:49.358 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:49.358 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:49.358 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:49.359 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:49.359 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:49.359 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:49.359 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:49.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:49.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:49.416 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:49.417 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.417 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.417 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.417 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.417 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.417 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.418 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.418 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.418 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.418 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:49.450 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.461498 25551 rpc_server.cc:307] RPC server started. Bound to: 127.24.66.3:36399
12:16:49.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.461604 25684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.24.66.3:36399 every 8 connection(s)
12:16:49.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.464705 25551 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/data/info.pb
12:16:49.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.470417 24840 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu as pid 25551
12:16:49.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.470870 24840 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskgjdPqB/test-tmp/mini-kudu-cluster9509740315343669555/ts-2/wal/instance
12:16:49.482 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:49.482 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:49.483 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:49.483 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.483 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.483 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:49.483 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.483 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.484 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:49.484 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.484 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.484 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:49.484 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:49.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.508002 25685 heartbeater.cc:344] Connected to a master server at 127.24.66.60:33469
12:16:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.508543 25685 heartbeater.cc:461] Registering TS with master...
12:16:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.508646 25686 heartbeater.cc:344] Connected to a master server at 127.24.66.61:43045
12:16:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.509042 25686 heartbeater.cc:461] Registering TS with master...
12:16:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.509934 25685 heartbeater.cc:507] Master 127.24.66.60:33469 requested a full tablet report, sending...
12:16:49.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.510061 25686 heartbeater.cc:507] Master 127.24.66.61:43045 requested a full tablet report, sending...
12:16:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.512629 25095 ts_manager.cc:194] Registered new tserver with Master: 60f38d7e54994965809690b5a8afb3b1 (127.24.66.3:36399)
12:16:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.513152 25014 ts_manager.cc:194] Registered new tserver with Master: 60f38d7e54994965809690b5a8afb3b1 (127.24.66.3:36399)
12:16:49.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.513794 25687 heartbeater.cc:344] Connected to a master server at 127.24.66.62:39483
12:16:49.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.514253 25687 heartbeater.cc:461] Registering TS with master...
12:16:49.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.514860 25095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.24.66.3:36677
12:16:49.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.515235 25687 heartbeater.cc:507] Master 127.24.66.62:39483 requested a full tablet report, sending...
12:16:49.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.518594 24939 ts_manager.cc:194] Registered new tserver with Master: 60f38d7e54994965809690b5a8afb3b1 (127.24.66.3:36399)
12:16:49.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.525666 24840 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:16:49.537 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:16:49.537 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:16:49.538 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.66.62"
      port: 39483
    }
    bound_http_address {
      host: "127.24.66.62"
      port: 43493
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.66.61"
      port: 43045
    }
    bound_http_address {
      host: "127.24.66.61"
      port: 37485
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.66.60"
      port: 33469
    }
    bound_http_address {
      host: "127.24.66.60"
      port: 42445
    }
  }
}

12:16:49.538 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:16:49.539 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.66.1"
      port: 40341
    }
    bound_http_address {
      host: "127.24.66.1"
      port: 38347
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.66.2"
      port: 46049
    }
    bound_http_address {
      host: "127.24.66.2"
      port: 40879
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.66.3"
      port: 36399
    }
    bound_http_address {
      host: "127.24.66.3"
      port: 34825
    }
  }
}

12:16:49.539 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:16:49.540 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:49.543 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:49.543 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:49.544 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:49.544 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.110.124:37703(127.23.110.124:37703)] Successfully connected to peer
12:16:49.544 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.110.126:40817(127.23.110.126:40817)] Successfully connected to peer
12:16:49.546 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.110.125:35201(127.23.110.125:35201)] Successfully connected to peer
12:16:49.548 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.124
12:16:49.548 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.126
12:16:49.556 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:49.556 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:49.560 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.125
12:16:49.569 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:49.570 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x834967bd, L:/127.0.0.1:52810 - R:/127.23.110.124:37703] using SASL/PLAIN
12:16:49.572 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x885853d4, L:/127.0.0.1:47920 - R:/127.23.110.125:35201] using SASL/PLAIN
12:16:49.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:49.574 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=31), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.124:37703, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.126:40817, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.125:35201, [30ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.124:37703: OK, deferred=null) after lookup
12:16:49.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.578233 24197 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52810:
12:16:49.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.584 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x92070be5, L:/127.0.0.1:55002 - R:/127.23.110.126:40817] using SASL/PLAIN
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
12:16:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
12:16:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:49.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.585721 24197 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:16:49.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.635 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:49.644 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.690838 24622 tablet_service.cc:1511] Processing CreateTablet for tablet 4823348c082a4b7e9ba31b93b4a21b4c (DEFAULT_TABLE table=replication_test_table [id=09fae4b8cefe4dd08bb11f2ef4be861e]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:49.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.697430 24622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4823348c082a4b7e9ba31b93b4a21b4c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:49.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.697791 24371 tablet_service.cc:1511] Processing CreateTablet for tablet 4823348c082a4b7e9ba31b93b4a21b4c (DEFAULT_TABLE table=replication_test_table [id=09fae4b8cefe4dd08bb11f2ef4be861e]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:49.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.699775 24371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4823348c082a4b7e9ba31b93b4a21b4c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:49.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.707726 24765 tablet_service.cc:1511] Processing CreateTablet for tablet 4823348c082a4b7e9ba31b93b4a21b4c (DEFAULT_TABLE table=replication_test_table [id=09fae4b8cefe4dd08bb11f2ef4be861e]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:49.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.710210 24765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4823348c082a4b7e9ba31b93b4a21b4c. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:49.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.729200 25718 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Bootstrap starting.
12:16:49.730 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:49.730 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:49.731 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:49.731 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:49.731 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:49.731 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:49.731 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:49.731 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:49.731 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:49.731 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:49.731 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:49.732 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:49.732 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:49.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.735822 25719 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Bootstrap starting.
12:16:49.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.738871 25718 tablet_bootstrap.cc:654] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Neither blocks nor log segments found. Creating new log.
12:16:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.741248 25720 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Bootstrap starting.
12:16:49.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.741418 25718 log.cc:826] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Log is configured to *not* fsync() on all Append() calls
12:16:49.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.745512 25719 tablet_bootstrap.cc:654] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Neither blocks nor log segments found. Creating new log.
12:16:49.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.747999 25720 tablet_bootstrap.cc:654] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Neither blocks nor log segments found. Creating new log.
12:16:49.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.748114 25719 log.cc:826] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Log is configured to *not* fsync() on all Append() calls
12:16:49.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.748178 25718 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: No bootstrap required, opened a new log
12:16:49.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.748656 25718 ts_tablet_manager.cc:1403] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
12:16:49.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.750156 25720 log.cc:826] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Log is configured to *not* fsync() on all Append() calls
12:16:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.756158 25720 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: No bootstrap required, opened a new log
12:16:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.756628 25720 ts_tablet_manager.cc:1403] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
12:16:49.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.760563 25719 tablet_bootstrap.cc:492] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: No bootstrap required, opened a new log
12:16:49.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.761281 25719 ts_tablet_manager.cc:1403] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
12:16:49.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.779510 25720 raft_consensus.cc:359] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.780238 25720 raft_consensus.cc:385] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:49.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.780516 25720 raft_consensus.cc:740] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d4e99b44aa74c38b7d6bd2b759602a4, State: Initialized, Role: FOLLOWER
12:16:49.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.781457 25720 consensus_queue.cc:260] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.781504 25718 raft_consensus.cc:359] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.782403 25718 raft_consensus.cc:385] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:49.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.782698 25718 raft_consensus.cc:740] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf29054a41a4a2988efd660ec5f186f, State: Initialized, Role: FOLLOWER
12:16:49.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.785094 25720 ts_tablet_manager.cc:1434] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Time spent starting tablet: real 0.028s	user 0.027s	sys 0.000s
12:16:49.786 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:49.787 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:49.787 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:49.787 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:49.787 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:49.787 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:49.788 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:49.788 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:49.788 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:49.789 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:49.789 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:49.789 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:49.789 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.783645 25718 consensus_queue.cc:260] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.795 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.791648 25718 ts_tablet_manager.cc:1434] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Time spent starting tablet: real 0.043s	user 0.027s	sys 0.005s
12:16:49.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.794023 25719 raft_consensus.cc:359] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.795060 25719 raft_consensus.cc:385] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:49.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.795351 25719 raft_consensus.cc:740] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45bf22799a184117b4ce3874e955f2af, State: Initialized, Role: FOLLOWER
12:16:49.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.796368 25719 consensus_queue.cc:260] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:49.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:49.822489 25719 ts_tablet_manager.cc:1434] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Time spent starting tablet: real 0.061s	user 0.036s	sys 0.007s
12:16:49.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.858093 24839 tablet.cc:2406] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:49.913 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:49.913 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:49.914 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:49.914 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:49.914 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:49.914 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:49.914 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:49.914 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:49.914 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:49.914 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:49.914 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:49.914 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:49.914 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:49.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:49.926285 24694 tablet.cc:2406] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:49.950 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:49.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:50.004994 24451 tablet.cc:2406] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.039369 25724 raft_consensus.cc:493] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.040007 25724 raft_consensus.cc:515] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.043808 25724 leader_election.cc:290] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45bf22799a184117b4ce3874e955f2af (127.23.110.66:33115), 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335)
12:16:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.044850 25726 raft_consensus.cc:493] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.045451 25726 raft_consensus.cc:515] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:50.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.055181 25726 leader_election.cc:290] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335), 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67:40905)
12:16:50.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.073035 24642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bf22799a184117b4ce3874e955f2af" is_pre_election: true
12:16:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.073949 24642 raft_consensus.cc:2468] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in term 0.
12:16:50.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.079305 24718 leader_election.cc:304] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d4e99b44aa74c38b7d6bd2b759602a4, 45bf22799a184117b4ce3874e955f2af; no voters: 
12:16:50.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.079272 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf29054a41a4a2988efd660ec5f186f" is_pre_election: true
12:16:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.080161 24391 raft_consensus.cc:2468] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in term 0.
12:16:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.080209 25724 raft_consensus.cc:2804] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.080528 25724 raft_consensus.cc:493] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:50.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.080857 25724 raft_consensus.cc:3060] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 0 FOLLOWER]: Advancing to term 1
12:16:50.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.086194 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "45bf22799a184117b4ce3874e955f2af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf29054a41a4a2988efd660ec5f186f" is_pre_election: true
12:16:50.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.086745 24391 raft_consensus.cc:2468] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45bf22799a184117b4ce3874e955f2af in term 0.
12:16:50.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.087945 24576 leader_election.cc:304] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf29054a41a4a2988efd660ec5f186f, 45bf22799a184117b4ce3874e955f2af; no voters: 
12:16:50.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.088704 25726 raft_consensus.cc:2804] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:50.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.089048 25726 raft_consensus.cc:493] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:50.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.089366 25726 raft_consensus.cc:3060] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 0 FOLLOWER]: Advancing to term 1
12:16:50.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.090797 25724 raft_consensus.cc:515] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:50.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.093875 24642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45bf22799a184117b4ce3874e955f2af"
12:16:50.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.094285 24391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf29054a41a4a2988efd660ec5f186f"
12:16:50.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.094805 25724 leader_election.cc:290] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [CANDIDATE]: Term 1 election: Requested vote from peers 45bf22799a184117b4ce3874e955f2af (127.23.110.66:33115), 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335)
12:16:50.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.094831 24391 raft_consensus.cc:3060] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 0 FOLLOWER]: Advancing to term 1
12:16:50.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.099547 24785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "45bf22799a184117b4ce3874e955f2af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" is_pre_election: true
12:16:50.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.100581 24785 raft_consensus.cc:2393] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45bf22799a184117b4ce3874e955f2af in current term 1: Already voted for candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in this term.
12:16:50.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.102706 25726 raft_consensus.cc:515] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:50.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.103725 24642 raft_consensus.cc:2393] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in current term 1: Already voted for candidate 45bf22799a184117b4ce3874e955f2af in this term.
12:16:50.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.105317 24785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "45bf22799a184117b4ce3874e955f2af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4"
12:16:50.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.105540 24390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4823348c082a4b7e9ba31b93b4a21b4c" candidate_uuid: "45bf22799a184117b4ce3874e955f2af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf29054a41a4a2988efd660ec5f186f"
12:16:50.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.105944 24785 raft_consensus.cc:2393] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45bf22799a184117b4ce3874e955f2af in current term 1: Already voted for candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in this term.
12:16:50.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.107679 24575 leader_election.cc:304] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45bf22799a184117b4ce3874e955f2af; no voters: 0d4e99b44aa74c38b7d6bd2b759602a4, 2bf29054a41a4a2988efd660ec5f186f
12:16:50.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.111640 25726 leader_election.cc:290] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [CANDIDATE]: Term 1 election: Requested vote from peers 2bf29054a41a4a2988efd660ec5f186f (127.23.110.65:42335), 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67:40905)
12:16:50.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.112548 24391 raft_consensus.cc:2468] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d4e99b44aa74c38b7d6bd2b759602a4 in term 1.
12:16:50.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.112169 25726 raft_consensus.cc:2749] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
12:16:50.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.113729 24719 leader_election.cc:304] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d4e99b44aa74c38b7d6bd2b759602a4, 2bf29054a41a4a2988efd660ec5f186f; no voters: 45bf22799a184117b4ce3874e955f2af
12:16:50.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.115123 25724 raft_consensus.cc:2804] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 1 FOLLOWER]: Leader election won for term 1
12:16:50.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.117020 25724 raft_consensus.cc:697] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [term 1 LEADER]: Becoming Leader. State: Replica: 0d4e99b44aa74c38b7d6bd2b759602a4, State: Running, Role: LEADER
12:16:50.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.118981 25724 consensus_queue.cc:237] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } }
12:16:50.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.133047 24196 catalog_manager.cc:5697] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d4e99b44aa74c38b7d6bd2b759602a4 (127.23.110.67). New cstate: current_term: 1 leader_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d4e99b44aa74c38b7d6bd2b759602a4" member_type: VOTER last_known_addr { host: "127.23.110.67" port: 40905 } health_report { overall_health: HEALTHY } } }
12:16:50.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.189 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:50.189 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:50.189 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:50.189 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.189 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.189 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.189 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.189 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.190 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.190 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.190 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.190 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.190 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:50.273 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:50.273 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:50.274 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:50.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.274 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.274 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.274 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:50.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.329 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:50.330 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:50.330 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:50.330 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.330 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.330 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.330 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.330 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.330 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.330 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.330 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.330 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.330 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:50.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.466 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:50.466 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:50.466 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:50.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.467 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.467 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.467 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.467 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.467 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.467 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.467 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.467 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:50.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.489 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:50.501 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4823348c082a4b7e9ba31b93b4a21b4c for table 'replication_test_table' with partition [<start>, <end>)
12:16:50.502 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:50.502 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.110.124:37703, [3ms] Sub RPC GetTableLocations: received response from server master-127.23.110.124:37703: OK, deferred=null) after lookup
12:16:50.502 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] connecting to peer
12:16:50.503 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] Successfully connected to peer
12:16:50.512 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.515 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xefa51293, L:/127.0.0.1:53406 - R:/127.23.110.67:40905] using TOKEN/null
12:16:50.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.518822 25685 heartbeater.cc:499] Master 127.24.66.60:33469 was elected leader, sending a full tablet report...
12:16:50.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.529964 24642 raft_consensus.cc:1275] T 4823348c082a4b7e9ba31b93b4a21b4c P 45bf22799a184117b4ce3874e955f2af [term 1 FOLLOWER]: Refusing update from remote peer 0d4e99b44aa74c38b7d6bd2b759602a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:50.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.531006 24391 raft_consensus.cc:1275] T 4823348c082a4b7e9ba31b93b4a21b4c P 2bf29054a41a4a2988efd660ec5f186f [term 1 FOLLOWER]: Refusing update from remote peer 0d4e99b44aa74c38b7d6bd2b759602a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:16:50.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.531426 25724 consensus_queue.cc:1048] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45bf22799a184117b4ce3874e955f2af" member_type: VOTER last_known_addr { host: "127.23.110.66" port: 33115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.532555 25733 consensus_queue.cc:1048] T 4823348c082a4b7e9ba31b93b4a21b4c P 0d4e99b44aa74c38b7d6bd2b759602a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf29054a41a4a2988efd660ec5f186f" member_type: VOTER last_known_addr { host: "127.23.110.65" port: 42335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:50.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:50.555 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:50.555 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:50.555 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:50.555 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:50.555 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:50.556 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:50.556 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:50.556 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:50.556 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:50.556 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:50.556 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:50.556 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:50.556 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:50.557 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:50.557 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:50.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.556046 25736 mvcc.cc:204] Tried to move back new op lower bound from 7305269291112996864 to 7305269289459920896. Current Snapshot: MvccSnapshot[applied={T|T < 7305269291112996864}]
12:16:50.557 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.557 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.557 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:50.558 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.558 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.558 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:50.560 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.560 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.560 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:50.560 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:50.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.561851 25738 mvcc.cc:204] Tried to move back new op lower bound from 7305269291112996864 to 7305269289459920896. Current Snapshot: MvccSnapshot[applied={T|T < 7305269291112996864}]
12:16:50.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.600514 25740 mvcc.cc:204] Tried to move back new op lower bound from 7305269291112996864 to 7305269289459920896. Current Snapshot: MvccSnapshot[applied={T|T < 7305269291112996864}]
12:16:50.621 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:50.622 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:50.622 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:50.622 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.622 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.622 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.627 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.627 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.627 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.627 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:50.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.665 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:50.665 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:50.666 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:50.666 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.666 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.666 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.666 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.666 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.666 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.666 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.666 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.666 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:50.700 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:50.700 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:50.700 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:50.700 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.701 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.701 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.701 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.701 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.701 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.701 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.701 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.701 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.701 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:50.703 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:50.703 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:50.703 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:50.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.704 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.704 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.704 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.704 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.704 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.704 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:50.785 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:50.788 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:50.791 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:50.793 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:50.793 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:50.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.799 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:50.800 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:50.800 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:50.807 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.809 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2b2be732, L:/127.0.0.1:43976 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:50.814 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:50.822 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.825 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:50.827 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5e6905ad, L:/127.0.0.1:56334 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:50.847 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:50.856 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.857 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:50.857 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:50.857 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:50.857 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.858 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.858 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:50.858 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.858 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.858 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:50.858 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.858 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.858 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:50.858 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:50.859 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xd1033030, L:/127.0.0.1:35824 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:50.863 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:50.863 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=74), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [32ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:50.866 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:50.867 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:50.867 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.110.124:37703(127.23.110.124:37703)] Successfully connected to peer
12:16:50.875 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.124
12:16:50.881 [DEBUG - main] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:50.883 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.110.126:40817(127.23.110.126:40817)] Successfully connected to peer
12:16:50.883 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:50.884 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:50.884 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:50.884 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.884 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.884 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.885 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.885 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:50.885 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.885 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.885 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:50.885 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:50.885 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:50.891 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.894 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5e2d095d, L:/127.0.0.1:52826 - R:/127.23.110.124:37703] using SASL/PLAIN
12:16:50.896 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.110.125:35201(127.23.110.125:35201)] Successfully connected to peer
12:16:50.897 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.126
12:16:50.898 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:50.898 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.124:37703, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.126:40817, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.125:35201, [32ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.124:37703: OK, deferred=null) after lookup
12:16:50.901 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:50.901 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:50.901 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:50.902 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.902 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.902 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:50.902 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.902 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.902 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:50.902 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.902 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.902 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:50.902 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:50.902 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:50.907 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4823348c082a4b7e9ba31b93b4a21b4c for table 'replication_test_table' with partition [<start>, <end>)
12:16:50.907 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:50.912 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.125
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:50.910887 25095 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35824:
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "replication_test_table"
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int8"
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT8
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int16"
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT16
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int32"
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "int64"
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT64
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "bool"
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "float"
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: FLOAT
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "double"
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DOUBLE
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "string"
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-array"
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "binary-bytebuffer"
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BINARY
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "null"
12:16:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "timestamp"
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: UNIXTIME_MICROS
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "decimal"
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DECIMAL32
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       precision: 5
12:16:50.916 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       scale: 3
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "varchar"
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: VARCHAR
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type_attributes {
12:16:50.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       length: 10
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "date"
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: DATE
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: AUTO_ENCODING
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: DEFAULT_COMPRESSION
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) split_rows_range_bounds {
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   rows: "<redacted>""\006\000\000\000\000\007\000\000\000\000"
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "int8"
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:16:50.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) comment: ""
12:16:50.920 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:50.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:50.923070 25095 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replication_test_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:16:50.923 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa7438e47, L:/127.0.0.1:55010 - R:/127.23.110.126:40817] using SASL/PLAIN
12:16:50.923 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x5c8f1315, L:/127.0.0.1:47928 - R:/127.23.110.125:35201] using SASL/PLAIN
12:16:50.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:50.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:51.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.056123 25422 tablet_service.cc:1511] Processing CreateTablet for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 (DEFAULT_TABLE table=replication_test_table [id=7a7455a1852444a5ac6c1971e23c8767]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:51.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.058085 25422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:51.062 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:51.062 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:51.062 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:51.063 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:51.063 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:51.063 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:51.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:51.063 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:51.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:51.063 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:51.063 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:51.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:51.063 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:51.066 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:51.066 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:51.066 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:51.067 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:51.067 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:51.067 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:51.067 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:51.067 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:51.067 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:51.067 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:51.067 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:51.067 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:51.067 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:51.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.081521 25619 tablet_service.cc:1511] Processing CreateTablet for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 (DEFAULT_TABLE table=replication_test_table [id=7a7455a1852444a5ac6c1971e23c8767]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:51.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.083590 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:51.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.088156 25267 tablet_service.cc:1511] Processing CreateTablet for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 (DEFAULT_TABLE table=replication_test_table [id=7a7455a1852444a5ac6c1971e23c8767]), partition=RANGE (int8) PARTITION UNBOUNDED
12:16:51.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.096798 25267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2. 1 dirs total, 0 dirs full, 0 dirs failed
12:16:51.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.099123 25778 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Bootstrap starting.
12:16:51.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.113907 25778 tablet_bootstrap.cc:654] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Neither blocks nor log segments found. Creating new log.
12:16:51.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.117151 25778 log.cc:826] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Log is configured to *not* fsync() on all Append() calls
12:16:51.117 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:51.117 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:51.117 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:51.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:51.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:51.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:51.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:51.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:51.118 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:51.118 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:51.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:51.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:51.119 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:51.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.137516 25781 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Bootstrap starting.
12:16:51.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.146826 25781 tablet_bootstrap.cc:654] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Neither blocks nor log segments found. Creating new log.
12:16:51.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.148294 25780 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Bootstrap starting.
12:16:51.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.149250 25781 log.cc:826] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Log is configured to *not* fsync() on all Append() calls
12:16:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.150645 25778 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: No bootstrap required, opened a new log
12:16:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.151324 25778 ts_tablet_manager.cc:1403] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Time spent bootstrapping tablet: real 0.053s	user 0.032s	sys 0.000s
12:16:51.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.155494 25781 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: No bootstrap required, opened a new log
12:16:51.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.155977 25781 ts_tablet_manager.cc:1403] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
12:16:51.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.168717 25780 tablet_bootstrap.cc:654] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Neither blocks nor log segments found. Creating new log.
12:16:51.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.171279 25780 log.cc:826] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Log is configured to *not* fsync() on all Append() calls
12:16:51.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.182453 25781 raft_consensus.cc:359] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.183413 25781 raft_consensus.cc:385] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:51.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.183701 25781 raft_consensus.cc:740] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c6ea42ecac400180703835b5daafac, State: Initialized, Role: FOLLOWER
12:16:51.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.184666 25781 consensus_queue.cc:260] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.188552 25780 tablet_bootstrap.cc:492] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: No bootstrap required, opened a new log
12:16:51.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.189344 25780 ts_tablet_manager.cc:1403] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.004s
12:16:51.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.189610 25778 raft_consensus.cc:359] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.190546 25778 raft_consensus.cc:385] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:51.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.191028 25778 raft_consensus.cc:740] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d447ba7a00542faa1c4377230a6debb, State: Initialized, Role: FOLLOWER
12:16:51.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.191936 25778 consensus_queue.cc:260] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.197575 25781 ts_tablet_manager.cc:1434] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Time spent starting tablet: real 0.041s	user 0.022s	sys 0.017s
12:16:51.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.209295 25778 ts_tablet_manager.cc:1434] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Time spent starting tablet: real 0.056s	user 0.026s	sys 0.005s
12:16:51.213 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:51.213 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:51.213 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:51.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.214 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.214 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.214 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.214 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.214 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.214 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.214 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.214 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.215 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:51.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:51.217082 25548 tablet.cc:2406] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:51.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.232581 25780 raft_consensus.cc:359] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.233575 25780 raft_consensus.cc:385] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:16:51.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.233937 25780 raft_consensus.cc:740] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60f38d7e54994965809690b5a8afb3b1, State: Initialized, Role: FOLLOWER
12:16:51.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.234824 25780 consensus_queue.cc:260] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.244840 25780 ts_tablet_manager.cc:1434] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Time spent starting tablet: real 0.055s	user 0.031s	sys 0.008s
12:16:51.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.333 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:51.333 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:51.333 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:51.333 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.333 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.333 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.333 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.333 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:51.334 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:51.334 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:51.334 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:51.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:51.396112 25340 tablet.cc:2406] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:51.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:16:51.478960 25688 tablet.cc:2406] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:16:51.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.488729 25786 raft_consensus.cc:493] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:16:51.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.489281 25786 raft_consensus.cc:515] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.494347 25786 leader_election.cc:290] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d447ba7a00542faa1c4377230a6debb (127.24.66.2:46049), 53c6ea42ecac400180703835b5daafac (127.24.66.1:40341)
12:16:51.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.506650 25287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e56d74d6b4145f3b5e3ca9a5369c9e2" candidate_uuid: "60f38d7e54994965809690b5a8afb3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53c6ea42ecac400180703835b5daafac" is_pre_election: true
12:16:51.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.506716 25442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e56d74d6b4145f3b5e3ca9a5369c9e2" candidate_uuid: "60f38d7e54994965809690b5a8afb3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d447ba7a00542faa1c4377230a6debb" is_pre_election: true
12:16:51.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.507434 25287 raft_consensus.cc:2468] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60f38d7e54994965809690b5a8afb3b1 in term 0.
12:16:51.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.507498 25442 raft_consensus.cc:2468] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60f38d7e54994965809690b5a8afb3b1 in term 0.
12:16:51.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.508733 25571 leader_election.cc:304] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53c6ea42ecac400180703835b5daafac, 60f38d7e54994965809690b5a8afb3b1; no voters: 
12:16:51.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.509591 25786 raft_consensus.cc:2804] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:16:51.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.509935 25786 raft_consensus.cc:493] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:16:51.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.510213 25786 raft_consensus.cc:3060] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 0 FOLLOWER]: Advancing to term 1
12:16:51.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.515743 25786 raft_consensus.cc:515] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.517539 25786 leader_election.cc:290] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [CANDIDATE]: Term 1 election: Requested vote from peers 1d447ba7a00542faa1c4377230a6debb (127.24.66.2:46049), 53c6ea42ecac400180703835b5daafac (127.24.66.1:40341)
12:16:51.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.518217 25442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e56d74d6b4145f3b5e3ca9a5369c9e2" candidate_uuid: "60f38d7e54994965809690b5a8afb3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d447ba7a00542faa1c4377230a6debb"
12:16:51.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.518702 25442 raft_consensus.cc:3060] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 0 FOLLOWER]: Advancing to term 1
12:16:51.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.518708 25287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e56d74d6b4145f3b5e3ca9a5369c9e2" candidate_uuid: "60f38d7e54994965809690b5a8afb3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53c6ea42ecac400180703835b5daafac"
12:16:51.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.519259 25287 raft_consensus.cc:3060] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 0 FOLLOWER]: Advancing to term 1
12:16:51.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.525848 25287 raft_consensus.cc:2468] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 53c6ea42ecac400180703835b5daafac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60f38d7e54994965809690b5a8afb3b1 in term 1.
12:16:51.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.526031 25442 raft_consensus.cc:2468] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 1d447ba7a00542faa1c4377230a6debb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60f38d7e54994965809690b5a8afb3b1 in term 1.
12:16:51.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.526990 25571 leader_election.cc:304] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53c6ea42ecac400180703835b5daafac, 60f38d7e54994965809690b5a8afb3b1; no voters: 
12:16:51.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.527690 25786 raft_consensus.cc:2804] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 1 FOLLOWER]: Leader election won for term 1
12:16:51.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.529366 25786 raft_consensus.cc:697] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [term 1 LEADER]: Becoming Leader. State: Replica: 60f38d7e54994965809690b5a8afb3b1, State: Running, Role: LEADER
12:16:51.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.530584 25786 consensus_queue.cc:237] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } }
12:16:51.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:51.540369 25094 catalog_manager.cc:5697] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 60f38d7e54994965809690b5a8afb3b1 (127.24.66.3). New cstate: current_term: 1 leader_uuid: "60f38d7e54994965809690b5a8afb3b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60f38d7e54994965809690b5a8afb3b1" member_type: VOTER last_known_addr { host: "127.24.66.3" port: 36399 } health_report { overall_health: HEALTHY } } }
12:16:51.553 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:51.554 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:51.554 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:51.554 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:51.554 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:51.554 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:51.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:51.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:51.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:51.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:51.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:51.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:51.555 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:51.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.614 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.126:40817(127.23.110.126:40817)] disconnecting while in state READY
12:16:51.614 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.125:35201(127.23.110.125:35201)] disconnecting while in state READY
12:16:51.614 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.124:37703(127.23.110.124:37703)] disconnecting while in state READY
12:16:51.615 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.110.126:40817(127.23.110.126:40817)] handling channelInactive
12:16:51.615 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.110.124:37703(127.23.110.124:37703)] handling channelInactive
12:16:51.615 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:51.615 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state READY due to: connection closed
12:16:51.616 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:16:51.615 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state READY due to: connection closed
12:16:51.616 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:51.618 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.110.125:35201(127.23.110.125:35201)] handling channelInactive
12:16:51.618 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state READY due to: connection closed
12:16:51.618 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-2
12:16:51.618 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state READY
12:16:51.618 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state READY
12:16:51.619 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state READY
12:16:51.619 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:51.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:51.619 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:51.619 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:51.620 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:51.620 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:16:51.620 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:16:51.621 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:51.621 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:51.621 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
12:16:51.623 [INFO - main] (TypeExtractor.java:2144) Field Row#fieldByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:51.624 [INFO - main] (TypeExtractor.java:2069) class java.util.LinkedHashMap does not contain a getter for field accessOrder
12:16:51.624 [INFO - main] (TypeExtractor.java:2072) class java.util.LinkedHashMap does not contain a setter for field accessOrder
12:16:51.624 [INFO - main] (TypeExtractor.java:2116) Class class java.util.LinkedHashMap cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:51.624 [INFO - main] (TypeExtractor.java:2144) Field Row#positionByName will be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:51.625 [INFO - main] (TypeExtractor.java:2197) class org.apache.flink.types.Row is missing a default constructor so it cannot be used as a POJO type and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance and schema evolution.
12:16:51.631 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
12:16:51.632 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
12:16:51.632 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
12:16:51.632 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
12:16:51.632 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
12:16:51.632 [INFO - main] (TaskExecutorResourceUtils.java:281) The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
12:16:51.633 [INFO - main] (MiniCluster.java:324) Starting Flink Mini Cluster
12:16:51.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.673 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:51.673 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:51.673 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:51.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:51.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:51.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:51.673 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:51.673 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:51.673 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:51.674 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:51.674 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:51.674 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:51.674 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:51.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.843 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:51.844 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:51.844 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:51.844 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:51.844 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:51.844 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:51.844 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:51.844 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:51.844 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:51.844 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:51.844 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:51.845 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:51.845 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:51.852 [INFO - main] (MiniCluster.java:343) Starting Metrics Registry
12:16:51.900 [INFO - main] (MetricRegistryImpl.java:177) No metrics reporter configured, no metrics will be exposed/reported.
12:16:51.900 [INFO - main] (MetricRegistryImpl.java:240) No trace reporter configured, no metrics will be exposed/reported.
12:16:51.900 [INFO - main] (MiniCluster.java:350) Starting RPC Service(s)
12:16:51.912 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:16:51.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:51.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.016 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:52.017 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:52.017 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:52.017 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.017 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.017 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.018 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.018 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.018 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.018 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.018 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.018 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:52.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:52.105345 25810 consensus_queue.cc:1048] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d447ba7a00542faa1c4377230a6debb" member_type: VOTER last_known_addr { host: "127.24.66.2" port: 46049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:16:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:52.127977 25810 consensus_queue.cc:1048] T 7e56d74d6b4145f3b5e3ca9a5369c9e2 P 60f38d7e54994965809690b5a8afb3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53c6ea42ecac400180703835b5daafac" member_type: VOTER last_known_addr { host: "127.24.66.1" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:16:52.144 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.220 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:52.220 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:52.220 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:52.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:52.221 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.221 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.221 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:52.220 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.221 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.221 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:52.221 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:52.294 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:52.294 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:52.294 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:52.294 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:52.294 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:52.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:52.294 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:52.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:52.294 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:52.294 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:52.294 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:52.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:52.295 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:52.295 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.465 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:52.466 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:52.466 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:52.466 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:52.466 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:52.466 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:52.466 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:52.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:52.466 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:52.466 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:52.466 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:52.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:52.466 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:52.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.513 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:52.513 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:52.514 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:52.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:52.514 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:52.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:52.514 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:52.514 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:52.514 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:52.514 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:52.514 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:52.514 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:52.514 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:52.543 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:52.544 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:52.544 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:52.544 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:52.544 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:52.544 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:52.545 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:52.545 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:52.545 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:52.545 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:52.545 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:52.545 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:52.545 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:52.570 [INFO - flink-pekko.actor.default-dispatcher-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:16:52.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.643 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.727 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink
12:16:52.739 [INFO - main] (ActorSystemBootstrapTools.java:227) Trying to start local actor system
12:16:52.766 [INFO - flink-metrics-4] (Slf4jLogger.scala:117) Slf4jLogger started
12:16:52.777 [INFO - main] (ActorSystemBootstrapTools.java:257) Actor system started at pekko://flink-metrics
12:16:52.790 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService .
12:16:52.797 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.798 [INFO - main] (DefaultDelegationTokenManager.java:127) Loading delegation token providers
12:16:52.799 [INFO - main] (HadoopFSDelegationTokenProvider.java:78) Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration".
12:16:52.799 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hadoopfs loaded and initialized
12:16:52.800 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider hbase loaded and initialized
12:16:52.800 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider test loaded and initialized
12:16:52.800 [INFO - main] (DefaultDelegationTokenManager.java:135) Delegation token provider throw loaded and initialized
12:16:52.800 [INFO - main] (DefaultDelegationTokenManager.java:165) Delegation token providers loaded successfully
12:16:52.800 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:16:52.801 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:16:52.801 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:16:52.802 [INFO - main] (DefaultDelegationTokenManager.java:189) Checking provider and receiver instances consistency
12:16:52.802 [INFO - main] (DefaultDelegationTokenManager.java:209) Provider and receiver instances are consistent
12:16:52.802 [INFO - main] (DefaultDelegationTokenManager.java:240) Obtaining delegation tokens
12:16:52.802 [INFO - main] (DefaultDelegationTokenManager.java:243) Delegation tokens obtained successfully
12:16:52.802 [WARN - main] (DefaultDelegationTokenManager.java:248) No tokens obtained so skipping notifications
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:64) Loading delegation token receivers
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hadoopfs loaded and initialized
12:16:52.802 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver hbase loaded and initialized
12:16:52.803 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver test loaded and initialized
12:16:52.803 [INFO - main] (DelegationTokenReceiverRepository.java:72) Delegation token receiver throw loaded and initialized
12:16:52.803 [INFO - main] (DelegationTokenReceiverRepository.java:101) Delegation token receivers loaded successfully
12:16:52.803 [INFO - main] (BlobServer.java:165) Created BLOB server storage directory /tmp/minicluster_ddd63cbe7e58177704cc4d7de9c994cc/blobStorage
12:16:52.804 [INFO - main] (BlobServer.java:239) Started BLOB server at 0.0.0.0:46451 - max concurrent requests: 50 - max backlog: 1000
12:16:52.804 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ddd63cbe7e58177704cc4d7de9c994cc/blobStorage
12:16:52.805 [INFO - main] (AbstractBlobCache.java:93) Created BLOB cache storage directory /tmp/minicluster_ddd63cbe7e58177704cc4d7de9c994cc/blobStorage
12:16:52.817 [INFO - main] (MiniCluster.java:744) Starting 1 TaskManager(s)
12:16:52.817 [INFO - main] (TaskManagerRunner.java:609) Starting TaskManager with ResourceID: 69d16ecb-1957-4ae7-87b0-a75631ebe6de
12:16:52.819 [INFO - main] (TaskManagerServices.java:552) Temporary file directory '/tmp': total 48 GB, usable 36 GB (75.00% usable)
12:16:52.820 [INFO - main] (IOManager.java:60) Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/tmp/flink-io-d504622c-f829-4929-9533-9573a6bedefc
12:16:52.827 [INFO - main] (NettyShuffleServiceFactory.java:170) Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/tmp/flink-netty-shuffle-621f190b-3ca1-4610-82db-d2f862650930
12:16:52.883 [INFO - main] (NetworkBufferPool.java:156) Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
12:16:52.884 [INFO - main] (NettyShuffleEnvironment.java:355) Starting the network environment and its components.
12:16:52.884 [INFO - main] (TaskManagerServices.java:353) TaskManager data connection initialized successfully; listening internally on port: -1
12:16:52.884 [INFO - main] (KvStateService.java:92) Starting the kvState service and its components.
12:16:52.885 [INFO - main] (Configuration.java:985) Config uses fallback configuration key 'pekko.ask.timeout' instead of key 'taskmanager.slot.timeout'
12:16:52.889 [INFO - main] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at pekko://flink/user/rpc/taskmanager_24 .
12:16:52.894 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:127) Start job leader service.
12:16:52.894 [INFO - flink-pekko.actor.default-dispatcher-4] (FileCache.java:116) User file cache uses directory /tmp/flink-dist-cache-0a1c5e70-da2f-4d46-b0b7-cf3a4b7f79c9
12:16:52.895 [INFO - main] (RestServerEndpoint.java:182) Starting rest endpoint.
12:16:52.895 [INFO - main] (DispatcherRestEndpoint.java:124) Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
12:16:52.906 [WARN - main] (WebMonitorUtils.java:76) Log file environment variable 'log.file' is not set.
12:16:52.906 [WARN - main] (WebMonitorUtils.java:82) JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
12:16:52.911 [INFO - main] (RestServerEndpoint.java:308) Rest endpoint listening at localhost:34275
12:16:52.912 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'rest_server'.
12:16:52.913 [INFO - mini-cluster-io-thread-1] (WebMonitorEndpoint.java:1203) http://localhost:34275 was granted leadership with leaderSessionID=74bfed58-bcfa-4452-8b4a-7573b4210b67
12:16:52.913 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader http://localhost:34275 , session=74bfed58-bcfa-4452-8b4a-7573b4210b67
12:16:52.913 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'dispatcher'.
12:16:52.914 [INFO - main] (ResourceManagerServiceImpl.java:118) Starting resource manager service.
12:16:52.914 [INFO - main] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'resource_manager'.
12:16:52.914 [INFO - mini-cluster-io-thread-2] (DefaultDispatcherRunner.java:114) DefaultDispatcherRunner was granted leadership with leader id 59c4fd1b-7dbc-4126-8a08-debccb1860ec. Creating new DispatcherLeaderProcess.
12:16:52.914 [INFO - mini-cluster-io-thread-2] (AbstractDispatcherLeaderProcess.java:99) Start SessionDispatcherLeaderProcess.
12:16:52.915 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:144) Recover all persisted job graphs that are not finished, yet.
12:16:52.915 [INFO - mini-cluster-io-thread-2] (SessionDispatcherLeaderProcess.java:158) Successfully recovered 0 persisted job graphs.
12:16:52.917 [INFO - pool-507-thread-1] (ResourceManagerServiceImpl.java:198) Resource manager service is granted leadership with session id f8bcab86-d77b-4f3b-9c6e-933dbaf3a5b6.
12:16:52.917 [INFO - mini-cluster-io-thread-2] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_25 .
12:16:52.918 [INFO - pool-507-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_26 .
12:16:52.923 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:253) Starting the resource manager.
12:16:52.928 [INFO - main] (MiniCluster.java:510) Flink Mini Cluster started successfully
12:16:52.929 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:212) Starting the slot manager.
12:16:52.929 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:308) Starting tokens update task
12:16:52.929 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:320) No tokens obtained so skipping notifications
12:16:52.929 [WARN - flink-pekko.actor.default-dispatcher-4] (DefaultDelegationTokenManager.java:335) Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date
12:16:52.930 [INFO - mini-cluster-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/resourcemanager_26 , session=f8bcab86-d77b-4f3b-9c6e-933dbaf3a5b6
12:16:52.930 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1478) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(9c6e933dbaf3a5b6f8bcab86d77b4f3b).
12:16:52.942 [INFO - mini-cluster-io-thread-2] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/dispatcher_25 , session=59c4fd1b-7dbc-4126-8a08-debccb1860ec
12:16:52.950 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.956 [INFO - flink-pekko.actor.default-dispatcher-4] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:16:52.983 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:52.986 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1080) Registering TaskManager with ResourceID 69d16ecb-1957-4ae7-87b0-a75631ebe6de (pekko://flink/user/rpc/taskmanager_24) at ResourceManager
12:16:52.987 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:516) Received JobGraph submission 'Flink Streaming Job' (a80b2d6bcff6a8f46968361f50aad224).
12:16:52.987 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutorToResourceManagerConnection.java:99) Successful registration at resource manager pekko://flink/user/rpc/resourcemanager_26 under registration id 2ac3bdf8955a57e055c01312de8fc4fa.
12:16:52.988 [INFO - flink-pekko.actor.default-dispatcher-7] (Dispatcher.java:601) Submitting job 'Flink Streaming Job' (a80b2d6bcff6a8f46968361f50aad224).
12:16:52.988 [INFO - flink-pekko.actor.default-dispatcher-7] (EmbeddedLeaderService.java:316) Proposing leadership to the contender that is registered under component ID 'job-a80b2d6bcff6a8f46968361f50aad224'.
12:16:52.989 [INFO - mini-cluster-io-thread-3] (JobMasterServiceLeadershipRunner.java:324) JobMasterServiceLeadershipRunner for job a80b2d6bcff6a8f46968361f50aad224 was granted leadership with leader id 286e7c87-aebe-473b-928e-12e3a0a949fd. Creating new JobMasterServiceProcess.
12:16:52.989 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:344) Registering task executor 69d16ecb-1957-4ae7-87b0-a75631ebe6de under 2ac3bdf8955a57e055c01312de8fc4fa at the slot manager.
12:16:53.002 [INFO - jobmanager-io-thread-1] (PekkoRpcService.java:271) Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_27 .
12:16:53.006 [INFO - jobmanager-io-thread-1] (JobMaster.java:319) Initializing job 'Flink Streaming Job' (a80b2d6bcff6a8f46968361f50aad224).
12:16:53.007 [INFO - jobmanager-io-thread-1] (DefaultSchedulerFactory.java:108) Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for Flink Streaming Job (a80b2d6bcff6a8f46968361f50aad224).
12:16:53.007 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraph.java:393) Created execution graph ab09ebb9aacd7d0cdc67b9c74f7dc2a0 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.007 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:179) Running initialization on master for job Flink Streaming Job (a80b2d6bcff6a8f46968361f50aad224).
12:16:53.007 [INFO - jobmanager-io-thread-1] (DefaultExecutionGraphBuilder.java:208) Successfully ran initialization on master in 0 ms.
12:16:53.008 [INFO - jobmanager-io-thread-1] (DefaultExecutionTopology.java:416) Built 4 new pipelined regions in 0 ms, total 4 pipelined regions currently.
12:16:53.008 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2b3ab3c2
12:16:53.009 [INFO - jobmanager-io-thread-1] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.009 [INFO - jobmanager-io-thread-1] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16967090099317924946/checkpoints")
12:16:53.010 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1778) No checkpoint found during restore.
12:16:53.010 [INFO - jobmanager-io-thread-1] (DefaultScheduler.java:168) Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@8a50454 for Flink Streaming Job (a80b2d6bcff6a8f46968361f50aad224).
12:16:53.011 [INFO - jobmanager-io-thread-1] (EmbeddedLeaderService.java:261) Received confirmation of leadership for leader pekko://flink/user/rpc/jobmanager_27 , session=286e7c87-aebe-473b-928e-12e3a0a949fd
12:16:53.011 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:987) Starting execution of job 'Flink Streaming Job' (a80b2d6bcff6a8f46968361f50aad224) under job master id 928e12e3a0a949fd286e7c87aebe473b.
12:16:53.012 [INFO - flink-pekko.actor.default-dispatcher-8] (SourceCoordinator.java:213) Starting split enumerator for source Source: KuduSource.
12:16:53.013 [DEBUG - flink-pekko.actor.default-dispatcher-8] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.014 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:231) Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
12:16:53.014 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a80b2d6bcff6a8f46968361f50aad224) switched from state CREATED to RUNNING.
12:16:53.015 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
12:16:53.015 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:53.016 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to SCHEDULED.
12:16:53.016 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:53.016 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to SCHEDULED.
12:16:53.017 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to SCHEDULED.
12:16:53.017 [INFO - flink-pekko.actor.default-dispatcher-8] (JobMaster.java:1182) Connecting to ResourceManager pekko://flink/user/rpc/resourcemanager_26(9c6e933dbaf3a5b6f8bcab86d77b4f3b)
12:16:53.018 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:53.018 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.110.124:37703(127.23.110.124:37703)] Successfully connected to peer
12:16:53.019 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved ResourceManager address, beginning registration
12:16:53.019 [INFO - flink-pekko.actor.default-dispatcher-6] (ResourceManager.java:390) Registering job manager 928e12e3a0a949fd286e7c87aebe473b@pekko://flink/user/rpc/jobmanager_27 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.021 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.110.125:35201(127.23.110.125:35201)] Successfully connected to peer
12:16:53.024 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.125
12:16:53.024 [INFO - flink-pekko.actor.default-dispatcher-4] (ResourceManager.java:1015) Registered job manager 928e12e3a0a949fd286e7c87aebe473b@pekko://flink/user/rpc/jobmanager_27 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.026 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.110.126:40817(127.23.110.126:40817)] Successfully connected to peer
12:16:53.028 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.124
12:16:53.031 [INFO - flink-pekko.actor.default-dispatcher-7] (JobMaster.java:1206) JobManager successfully registered at ResourceManager, leader id: 9c6e933dbaf3a5b6f8bcab86d77b4f3b.
12:16:53.031 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.126
12:16:53.031 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job a80b2d6bcff6a8f46968361f50aad224: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:53.035 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.035 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.041 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xccfdec7d, L:/127.0.0.1:47944 - R:/127.23.110.125:35201] using SASL/PLAIN
12:16:53.045 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.046 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x00094498, L:/127.0.0.1:52842 - R:/127.23.110.124:37703] using SASL/PLAIN
12:16:53.050 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.051 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=35), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.124:37703, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.126:40817, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.125:35201, [33ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.125:35201: OK, [35ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.124:37703: OK, deferred=null) after lookup
12:16:53.051 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xaaf67b0a, L:/127.0.0.1:55016 - R:/127.23.110.126:40817] using SASL/PLAIN
12:16:53.055 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:53.055 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:53.056 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:53.056 [DEBUG - main] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:53.057 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:53.057 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:53.060 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:709) Matching resource requirements against available resources.
Missing resources:
	 Job a80b2d6bcff6a8f46968361f50aad224
		ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}
Current resources:
	TaskManager 69d16ecb-1957-4ae7-87b0-a75631ebe6de
		Available: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
		Total:     ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}
12:16:53.060 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 4823348c082a4b7e9ba31b93b4a21b4c for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.061 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:53.062 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:53.067 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot cbac433aa669af19e123db907fb02541 from 69d16ecb-1957-4ae7-87b0-a75631ebe6de for job a80b2d6bcff6a8f46968361f50aad224 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.067 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot bce27d622a2c3ea09990d7c771aac4cd from 69d16ecb-1957-4ae7-87b0-a75631ebe6de for job a80b2d6bcff6a8f46968361f50aad224 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.067 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request cbac433aa669af19e123db907fb02541 for job a80b2d6bcff6a8f46968361f50aad224 from resource manager with leader id 9c6e933dbaf3a5b6f8bcab86d77b4f3b.
12:16:53.068 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot ad2a3d844e594889873b8a9451500fbb from 69d16ecb-1957-4ae7-87b0-a75631ebe6de for job a80b2d6bcff6a8f46968361f50aad224 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.068 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for cbac433aa669af19e123db907fb02541 with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.068 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultSlotStatusSyncer.java:112) Starting allocation of slot 25b27096f18cc45ecbcc3c787a155cfc from 69d16ecb-1957-4ae7-87b0-a75631ebe6de for job a80b2d6bcff6a8f46968361f50aad224 with resource profile ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.070 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.072 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x2a2d86a5, L:/127.0.0.1:56348 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:53.074 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:53.076 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:53.077 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultJobLeaderService.java:192) Add job a80b2d6bcff6a8f46968361f50aad224 for job leader monitoring.
12:16:53.077 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request bce27d622a2c3ea09990d7c771aac4cd for job a80b2d6bcff6a8f46968361f50aad224 from resource manager with leader id 9c6e933dbaf3a5b6f8bcab86d77b4f3b.
12:16:53.077 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for bce27d622a2c3ea09990d7c771aac4cd with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.077 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request ad2a3d844e594889873b8a9451500fbb for job a80b2d6bcff6a8f46968361f50aad224 from resource manager with leader id 9c6e933dbaf3a5b6f8bcab86d77b4f3b.
12:16:53.078 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for ad2a3d844e594889873b8a9451500fbb with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.078 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:1149) Receive slot request 25b27096f18cc45ecbcc3c787a155cfc for job a80b2d6bcff6a8f46968361f50aad224 from resource manager with leader id 9c6e933dbaf3a5b6f8bcab86d77b4f3b.
12:16:53.078 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:321) Allocated slot for 25b27096f18cc45ecbcc3c787a155cfc with resources ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}.
12:16:53.079 [INFO - mini-cluster-io-thread-3] (DefaultJobLeaderService.java:350) Try to register at job manager pekko://flink/user/rpc/jobmanager_27 with leader id 286e7c87-aebe-473b-928e-12e3a0a949fd.
12:16:53.084 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:53.085 [INFO - flink-pekko.actor.default-dispatcher-8] (RetryingRegistration.java:162) Resolved JobManager address, beginning registration
12:16:53.087 [INFO - flink-pekko.actor.default-dispatcher-4] (DefaultJobLeaderService.java:417) Successful registration at job manager pekko://flink/user/rpc/jobmanager_27 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.087 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1783) Establish JobManager connection for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.087 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:1633) Offer reserved slots to the leader of job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.088 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.088 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
12:16:53.088 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #0) with attempt id ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 69d16ecb-1957-4ae7-87b0-a75631ebe6de @ 127.0.0.1 (dataPort=-1) with allocation id ad2a3d844e594889873b8a9451500fbb
12:16:53.089 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ad2a3d844e594889873b8a9451500fbb.
12:16:53.089 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from SCHEDULED to DEPLOYING.
12:16:53.089 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (2/4) (attempt #0) with attempt id ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_1 to 69d16ecb-1957-4ae7-87b0-a75631ebe6de @ 127.0.0.1 (dataPort=-1) with allocation id 25b27096f18cc45ecbcc3c787a155cfc
12:16:53.090 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from SCHEDULED to DEPLOYING.
12:16:53.090 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (3/4) (attempt #0) with attempt id ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_2 to 69d16ecb-1957-4ae7-87b0-a75631ebe6de @ 127.0.0.1 (dataPort=-1) with allocation id cbac433aa669af19e123db907fb02541
12:16:53.090 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorFileMergingManager.java:83) Registered new file merging snapshot manager for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.091 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from SCHEDULED to DEPLOYING.
12:16:53.091 [INFO - flink-pekko.actor.default-dispatcher-4] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (4/4) (attempt #0) with attempt id ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_3 to 69d16ecb-1957-4ae7-87b0-a75631ebe6de @ 127.0.0.1 (dataPort=-1) with allocation id bce27d622a2c3ea09990d7c771aac4cd
12:16:53.092 [INFO - flink-pekko.actor.default-dispatcher-8] (StateChangelogStorageLoader.java:104) Creating a changelog storage with name 'memory'.
12:16:53.092 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutorChannelStateExecutorFactoryManager.java:70) Creating the channel state executor factory for job id a80b2d6bcff6a8f46968361f50aad224
12:16:53.093 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x00662a0f, L:/127.0.0.1:43986 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:53.094 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id ad2a3d844e594889873b8a9451500fbb.
12:16:53.095 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 25b27096f18cc45ecbcc3c787a155cfc.
12:16:53.095 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
12:16:53.095 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
12:16:53.097 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0), deploy into slot with allocation id 25b27096f18cc45ecbcc3c787a155cfc.
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2d1673c4
12:16:53.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16967090099317924946/checkpoints")
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CREATED to DEPLOYING.
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) [DEPLOYING].
12:16:53.098 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cbac433aa669af19e123db907fb02541.
12:16:53.098 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:16:53.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@50bb6d51
12:16:53.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16967090099317924946/checkpoints")
12:16:53.099 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
12:16:53.099 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:16:53.099 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from DEPLOYING to INITIALIZING.
12:16:53.103 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0), deploy into slot with allocation id cbac433aa669af19e123db907fb02541.
12:16:53.103 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.104 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot ad2a3d844e594889873b8a9451500fbb.
12:16:53.104 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot 25b27096f18cc45ecbcc3c787a155cfc.
12:16:53.104 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot cbac433aa669af19e123db907fb02541.
12:16:53.104 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot bce27d622a2c3ea09990d7c771aac4cd.
12:16:53.104 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskSlotTableImpl.java:391) Activate slot bce27d622a2c3ea09990d7c771aac4cd.
12:16:53.105 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CREATED to DEPLOYING.
12:16:53.105 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) [DEPLOYING].
12:16:53.106 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a50ad59
12:16:53.106 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.106 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16967090099317924946/checkpoints")
12:16:53.106 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:16:53.107 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from DEPLOYING to INITIALIZING.
12:16:53.107 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cb9fd4
12:16:53.107 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xeb98c686, L:/127.0.0.1:35834 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:53.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:53.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:53.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:53.111 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.111 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.111 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.111 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.111 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.111 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.111 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.112 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.112 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.112 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.112 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:53.114 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.114 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=60), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [20ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [40ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:53.117 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0), deploy into slot with allocation id bce27d622a2c3ea09990d7c771aac4cd.
12:16:53.118 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:53.118 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:53.118 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:53.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.118 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.118 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.118 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.119 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.119 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.119 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.119 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:53.119 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.120 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5faf6e02
12:16:53.121 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:53.123 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.123 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2@[1d447ba7a00542faa1c4377230a6debb(127.24.66.2:46049),53c6ea42ecac400180703835b5daafac(127.24.66.1:40341),60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)[L]]}]
12:16:53.124 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.66.60:33469, [4ms] Sub RPC GetTableLocations: received response from server master-127.24.66.60:33469: OK, deferred=null)) after lookup
12:16:53.124 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] connecting to peer
12:16:53.125 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from CREATED to DEPLOYING.
12:16:53.125 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) [DEPLOYING].
12:16:53.125 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@cb979b9
12:16:53.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit16967090099317924946/checkpoints")
12:16:53.126 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:16:53.127 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from DEPLOYING to INITIALIZING.
12:16:53.130 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:53.130 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:53.133 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:53.135 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4fc44d41
12:16:53.136 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.137 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3adf8d8d
12:16:53.141 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.143 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc8d37544, L:/127.0.0.1:43992 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:53.145 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.147 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:53.147 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:53.148 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:53.148 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] Successfully connected to peer
12:16:53.150 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:53.151 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:53.151 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:53.151 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:53.154 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.24.66.61:43045(127.24.66.61:43045)] connecting to peer
12:16:53.157 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:53.163 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.165 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:53.165 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:53.167 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe957cf62, L:/127.0.0.1:56362 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:53.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:53.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:53.169 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:53.169 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.169 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.169 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.169 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.169 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.169 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.170 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.170 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.170 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:53.170 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.170 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:53.170 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:53.170 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:53.170 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.170 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.170 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.170 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.170 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.170 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.171 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.171 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.171 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.171 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.171 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:53.171 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:53.175 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:53.175 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:53.176 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:53.177 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:53.178 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:53.179 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.180 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:53.210 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:53.212 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xc4fdef6d, L:/127.0.0.1:40248 - R:/127.24.66.3:36399] using TOKEN/null
12:16:53.212 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.214 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:53.216 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:53.222 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.24.66.62:39483(127.24.66.62:39483)] connecting to peer
12:16:53.223 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.66.61:43045(127.24.66.61:43045)] Successfully connected to peer
12:16:53.224 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:53.228 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9e409127, L:/127.0.0.1:44002 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:53.229 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.230 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9850a63d, L:/127.0.0.1:56376 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:53.231 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.232 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.61
12:16:53.235 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x452f6410, L:/127.0.0.1:44012 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:53.235 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer master-127.24.66.60:33469(127.24.66.60:33469)] connecting to peer
12:16:53.236 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.66.62:39483(127.24.66.62:39483)] Successfully connected to peer
12:16:53.237 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xce19453b, L:/127.0.0.1:35838 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:53.242 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.62
12:16:53.243 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.243 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=98), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [83ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:53.249 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.24.66.60:33469(127.24.66.60:33469)] Successfully connected to peer
12:16:53.251 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.252 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.253 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.254 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:53.256 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xbef1bd4a, L:/127.0.0.1:56388 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:53.261 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.263 [DEBUG - kudu-nio-1] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.268 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x37ede20e, L:/127.0.0.1:56392 - R:/127.24.66.62:39483] using SASL/PLAIN
12:16:53.268 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:53.269 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:53.269 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:53.269 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.269 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.270 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:53.270 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.270 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.270 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:53.270 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.270 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:53.270 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:53.271 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.271 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4f966415
12:16:53.273 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 2 (#0) @ 
12:16:53.273 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 2 (#0)
12:16:53.275 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfe8f219d, L:/127.0.0.1:44022 - R:/127.24.66.61:43045] using SASL/PLAIN
12:16:53.279 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.287 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x15ad65cb, L:/127.0.0.1:35854 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:53.292 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:53.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.302 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.66.60
12:16:53.305 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.307 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=193), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [25ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [48ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [185ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:53.309 [DEBUG - kudu-nio-2] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.310 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x0c08d21c, L:/127.0.0.1:35856 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:53.310 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job a80b2d6bcff6a8f46968361f50aad224 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job a80b2d6bcff6a8f46968361f50aad224 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.311 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.312 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:16:53.313 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x04ca3b83, L:/127.0.0.1:35870 - R:/127.24.66.60:33469] using SASL/PLAIN
12:16:53.313 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='3a362d9a09efaffd05d7c19fa0b37f1406bfd51aa782f500e02c25f09b2d671b'}]
12:16:53.315 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.315 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:53.316 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:53.320 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.320 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@8d0ad54
12:16:53.322 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.322 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=185), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [117ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [129ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [168ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:53.322 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.323 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:53.323 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=197), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.61:43045, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.62:39483, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.66.60:33469, [101ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.61:43045: OK, [111ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.62:39483: OK, [176ms] Sub RPC ConnectToMaster: received response from server master-127.24.66.60:33469: OK, deferred=null) after lookup
12:16:53.327 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.328 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.331 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.331 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@7774d433
12:16:53.332 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] connecting to peer
12:16:53.333 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:53.333 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5df97ef7
12:16:53.334 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:16:53.335 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from INITIALIZING to RUNNING.
12:16:53.335 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] Successfully connected to peer
12:16:53.336 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 0 (#0) @ 
12:16:53.336 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 0 (#0)
12:16:53.337 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:16:53.338 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 3 (#0) @ 
12:16:53.338 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 3 (#0)
12:16:53.338 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:16:53.340 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:606) Source Source: KuduSource registering reader for parallel task 1 (#0) @ 
12:16:53.340 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:567) Source Source: KuduSource received split request from parallel task 1 (#0)
12:16:53.342 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from INITIALIZING to RUNNING.
12:16:53.343 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.65
12:16:53.344 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
12:16:53.344 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from INITIALIZING to RUNNING.
12:16:53.351 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.356 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1ea83919, L:/127.0.0.1:48544 - R:/127.23.110.65:42335] using SASL/PLAIN
12:16:53.373 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false, responseScanTimestamp = 7305269301309440001) for scanner KuduScanner(table=replication_test_table, tablet=4823348c082a4b7e9ba31b93b4a21b4c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.373 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:108) Finished reading from splits [3a362d9a09efaffd05d7c19fa0b37f1406bfd51aa782f500e02c25f09b2d671b]
12:16:53.375 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (KryoSerializer.java:492) Kryo serializer scala extensions are not available.
12:16:53.381 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.395 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.395 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2@[1d447ba7a00542faa1c4377230a6debb(127.24.66.2:46049),53c6ea42ecac400180703835b5daafac(127.24.66.1:40341),60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)[L]]}]
12:16:53.400 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.400 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2@[1d447ba7a00542faa1c4377230a6debb(127.24.66.2:46049),53c6ea42ecac400180703835b5daafac(127.24.66.1:40341),60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)[L]]}]
12:16:53.400 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.400 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2@[1d447ba7a00542faa1c4377230a6debb(127.24.66.2:46049),53c6ea42ecac400180703835b5daafac(127.24.66.1:40341),60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)[L]]}]
12:16:53.401 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 7e56d74d6b4145f3b5e3ca9a5369c9e2 for table 'replication_test_table' with partition [<start>, <end>)
12:16:53.401 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2@[1d447ba7a00542faa1c4377230a6debb(127.24.66.2:46049),53c6ea42ecac400180703835b5daafac(127.24.66.1:40341),60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)[L]]}]
12:16:53.414 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [3a362d9a09efaffd05d7c19fa0b37f1406bfd51aa782f500e02c25f09b2d671b]
12:16:53.415 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:53.415 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:53.415 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] disconnecting while in state READY
12:16:53.415 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 3a362d9a09efaffd05d7c19fa0b37f1406bfd51aa782f500e02c25f09b2d671b finished by subtask 2; deferring removal (restored in pending)
12:16:53.416 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:53.421 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] handling channelInactive
12:16:53.421 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] cleaning up while in state READY due to: connection closed
12:16:53.421 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-0
12:16:53.421 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (3/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:53.437 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.445 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:53.445 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:53.445 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:53.445 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.446 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.446 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.446 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.446 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.446 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.446 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.446 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.446 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.446 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:53.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.494 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:53.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:53.502 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:53.503 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.503 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.503 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:53.503 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.503 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.503 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:53.503 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.503 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.503 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:53.504 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:53.551 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.582 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:53.582 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:53.583 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:53.583 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:53.583 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:53.583 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:53.583 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:53.583 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:53.583 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:53.584 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:53.584 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:53.584 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:53.584 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:53.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.616 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RESTARTING to RUNNING.
12:16:53.617 [INFO - flink-pekko.actor.default-dispatcher-7] (CheckpointCoordinator.java:1805) Restoring job 5184ffe83187ccec3ebfd9d613debdde from Checkpoint 68 @ 1783512916385 for 5184ffe83187ccec3ebfd9d613debdde located at file:/tmp/junit12827511199534343379/checkpoints/5184ffe83187ccec3ebfd9d613debdde/chk-68.
12:16:53.618 [INFO - flink-pekko.actor.default-dispatcher-7] (MasterHooks.java:201) No master state to restore
12:16:53.619 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED.
12:16:53.619 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
12:16:53.620 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:349) Recovering subtask 0 to checkpoint 68 for source Source: KuduSource to checkpoint.
12:16:53.621 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING.
12:16:53.621 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:563) Deploying Source: KuduSource -> Sink: Writer (1/4) (attempt #4) with attempt id 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1) with allocation id 71b57ea17b002970ac3f421ada230e68
12:16:53.625 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.629 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskSlotTableImpl.java:391) Activate slot 71b57ea17b002970ac3f421ada230e68.
12:16:53.630 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:825) Received task Source: KuduSource -> Sink: Writer (1/4)#4 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4), deploy into slot with allocation id 71b57ea17b002970ac3f421ada230e68.
12:16:53.633 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to DEPLOYING.
12:16:53.633 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:626) Loading JAR files for task Source: KuduSource -> Sink: Writer (1/4)#4 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) [DEPLOYING].
12:16:53.635 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cfde38d
12:16:53.635 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:315) State backend loader loads the state backend as HashMapStateBackend
12:16:53.635 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (CheckpointStorageLoader.java:261) Checkpoint storage is set to 'filesystem': (checkpoints "file:/tmp/junit12827511199534343379/checkpoints")
12:16:53.636 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#4 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:16:53.636 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING.
12:16:53.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.645 [INFO - Source: KuduSource -> Sink: Writer (1/4)#4] (StateBackendLoader.java:154) State backend is set to heap memory org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6bf1bcb9
12:16:53.650 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:53.660 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.664 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.665 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.665 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.665 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:53.665 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.665 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:53.665 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:53.666 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.666 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.666 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.666 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.666 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:53.667 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.666 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:53.667 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.667 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:53.667 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:53.672 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#4] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.673 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.673 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.673 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.673 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.673 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.673 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.673 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.681 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.681 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.682 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.682 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.682 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.682 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.683 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.683 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.683 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.683 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.683 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.683 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.683 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.683 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.701 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.701 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.702 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.702 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.702 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.702 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.702 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.702 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.703 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.703 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.703 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.703 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.703 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.721 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.721 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.721 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.721 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.721 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.721 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.721 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.721 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.721 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.722 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.722 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.722 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.722 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.740 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.740 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.740 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.741 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.741 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.741 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.741 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.741 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.741 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.741 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.741 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.741 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.741 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.761 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.761 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.761 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.761 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.761 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.761 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.762 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.762 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.762 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.761 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.762 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.762 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.762 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.788 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.797 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.800 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.801 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.801 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.801 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.801 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.801 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.802 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.802 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.802 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.805 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.805 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.805 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.805 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.810 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513013810 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:53.816 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (AsyncKuduSession.java:592) flushing buffer: Buffer{operations=10, operationSize=1800, flusherTask=org.apache.kudu.client.AsyncKuduSession$FlusherTask@59d58a1c, flushNotification=Deferred@880814267(state=PENDING, result=null, callback=<none>, errback=<none>)}
12:16:53.817 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:748) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] connecting to peer
12:16:53.851 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] Successfully connected to peer
12:16:53.854 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.860 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.860 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.860 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.861 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.861 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.861 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.861 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.861 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.861 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.861 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.861 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.862 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.862 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:53.883 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:53.887 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x425301a4, L:/127.0.0.1:40252 - R:/127.24.66.3:36399] using TOKEN/null
12:16:53.910 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:53.974 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:53.980 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:53.981 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:53.981 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:53.981 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.981 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.981 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:53.981 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.981 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.981 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:53.981 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.981 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:53.981 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:54.031 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:54.074 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:54.074 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:54.074 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:54.075 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.075 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.075 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.075 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.075 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.075 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.077 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:54.096 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:54.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.101 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:54.117 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 1 for job a80b2d6bcff6a8f46968361f50aad224 (1958 bytes, checkpointDuration=307 ms, finalizationTime=0 ms).
12:16:54.119 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 1 as completed for source Source: KuduSource.
12:16:54.119 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 1 complete: removed split 3a362d9a09efaffd05d7c19fa0b37f1406bfd51aa782f500e02c25f09b2d671b from pending
12:16:54.119 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 1 complete: removed 1 finished splits from enumerator state
12:16:54.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.144 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=4823348c082a4b7e9ba31b93b4a21b4c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:54.148 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7a7455a1852444a5ac6c1971e23c8767
12:16:54.157 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:54.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:54.158 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:54.158 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.158 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.158 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.158 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.158 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.158 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.158 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.158 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.158 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.160 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:54.162 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:54.163 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:54.163 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:54.163 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:54.163 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:54.163 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:54.163 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:54.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:54.163 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:54.164 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:54.164 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:54.164 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:54.164 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:54.174 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=replication_test_table, tablet=7e56d74d6b4145f3b5e3ca9a5369c9e2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:54.176 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:54.176 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state READY
12:16:54.177 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state READY
12:16:54.177 [DEBUG - main] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state READY
12:16:54.177 [DEBUG - main] (Connection.java:575) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] disconnecting while in state READY
12:16:54.177 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:54.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:54.177 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:54.177 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:54.177 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:54.177 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:54.178 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:54.178 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:54.178 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:54.178 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:54.179 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:54.179 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:54.179 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:54.179 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:54.180 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:54.180 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:54.180 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:54.180 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:54.180 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:54.181 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:16:54.181 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
12:16:54.181 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 19 thread-local buffer(s) from thread: kudu-nio-1
12:16:54.194 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] handling channelInactive
12:16:54.194 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] cleaning up while in state READY due to: connection closed
12:16:54.194 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
12:16:54.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.195241 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 25175
12:16:54.289 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.290338 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 25343
12:16:54.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.311 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513014310 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:54.322 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 2 for job a80b2d6bcff6a8f46968361f50aad224 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:54.326 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 2 as completed for source Source: KuduSource.
12:16:54.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:54.334 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:54.334 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:54.334 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:54.334 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:54.334 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:54.335 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:54.335 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:54.335 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:54.335 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:54.335 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:54.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:54.335 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:54.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.383237 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 25551
12:16:54.425 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] handling channelInactive
12:16:54.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] cleaning up while in state READY due to: connection closed
12:16:54.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.434568 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24852
12:16:54.441 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:54.441 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:54.441 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:54.441 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.441 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.441 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.442 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.442 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.442 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.442 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.442 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.442 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.442 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:54.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.66.62:39483(127.24.66.62:39483)] handling channelInactive
12:16:54.465 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.66.62:39483(127.24.66.62:39483)] cleaning up while in state READY due to: connection closed
12:16:54.471 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.472584 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24976
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:54.515 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:54.516 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.66.61:43045(127.24.66.61:43045)] handling channelInactive
12:16:54.516 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.66.61:43045(127.24.66.61:43045)] cleaning up while in state READY due to: connection closed
12:16:54.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:54.521719 24840 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 25051
12:16:54.525 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:54.526 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:54.526 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:54.526 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.526 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.526 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.527 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.527 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.527 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.527 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.527 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.527 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.527 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:54.555 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:54.555 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:54.555 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:54.556 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:54.556 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:54.556 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:54.556 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.24.66.60:33469(127.24.66.60:33469)] handling channelInactive
12:16:54.557 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.24.66.60:33469(127.24.66.60:33469)] cleaning up while in state READY due to: connection closed
12:16:54.567 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:54.567 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:54.567 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:54.567 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:54.567 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:54.568 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:54.568 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:54.569 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:54.569 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:54.569 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:54.569 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:54.569 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:54.569 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:54.576 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:54.577 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:54.577 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:54.577 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.577 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.577 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:54.577 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.577 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.577 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:54.578 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.578 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.578 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:54.578 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:54.596 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:54.596 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:54.596 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:54.596 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.597 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.597 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.597 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.597 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.597 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.597 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.597 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.597 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.597 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:54.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.624 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:54.624 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:54.624 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:54.624 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.624 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.625 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.625 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.625 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.625 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.625 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:54.625 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:54.625 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:54.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.626 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.626 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.626 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.626 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:54.626 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.626 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.626 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:54.626 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:54.627 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.627 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.627 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:54.627 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:54.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.674 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:54.674 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:54.674 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:54.675 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:54.675 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:54.675 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:54.675 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:54.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:54.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:54.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:54.675 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:54.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:54.675 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:54.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:54.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:54.762 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:54.762 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.763 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.763 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:54.763 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.763 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.763 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:54.763 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.763 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.763 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:54.763 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:54.788 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5184ffe83187ccec3ebfd9d613debdde since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5184ffe83187ccec3ebfd9d613debdde is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.810 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513014810 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:54.814 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:54.814 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:54.814 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:54.815 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.815 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.815 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:54.815 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.815 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.815 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:54.815 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.816 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.816 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:54.816 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:54.821 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 3 for job a80b2d6bcff6a8f46968361f50aad224 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:16:54.823 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 3 as completed for source Source: KuduSource.
12:16:54.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:54.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.019 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:55.021 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='32951798cacd0d392560515b1eeb92c50691f2cab7e8a7e985dceaa99043fed6'}]
12:16:55.023 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:55.026 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:55.027 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=298039, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:55.029 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:748) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] connecting to peer
12:16:55.039 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] Successfully connected to peer
12:16:55.059 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.65
12:16:55.071 [DEBUG - kudu-nio-0] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:55.083 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x46895f31, L:/127.0.0.1:48556 - R:/127.23.110.65:42335] using SASL/PLAIN
12:16:55.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.133 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false, responseScanTimestamp = 7305269309497344001) for scanner KuduScanner(table=replication_test_table, tablet=4823348c082a4b7e9ba31b93b4a21b4c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:16:55.134 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:108) Finished reading from splits [32951798cacd0d392560515b1eeb92c50691f2cab7e8a7e985dceaa99043fed6]
12:16:55.134 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:249) Finished reading split(s) [32951798cacd0d392560515b1eeb92c50691f2cab7e8a7e985dceaa99043fed6]
12:16:55.134 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcherManager.java:294) Closing splitFetcher 0 because it is idle.
12:16:55.134 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:55.138 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:216) Split 32951798cacd0d392560515b1eeb92c50691f2cab7e8a7e985dceaa99043fed6 finished by subtask 0; deferring removal (restored in pending)
12:16:55.139 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] disconnecting while in state READY
12:16:55.139 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:55.141 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.173 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] handling channelInactive
12:16:55.173 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] cleaning up while in state READY due to: connection closed
12:16:55.173 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 23 thread-local buffer(s) from thread: kudu-nio-0
12:16:55.173 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (1/4)#0] (SplitFetcher.java:128) Split fetcher 0 exited.
12:16:55.261 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:55.262 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:55.262 [DEBUG - pool-454-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:55.262 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.262 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.262 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.262 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.262 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.262 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.262 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.262 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.262 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.262 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:55.263 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29662), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [12ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [12ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [27ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [222ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2761ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@2050014109(state=PENDING, result=null, callback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571), errback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571)))
12:16:55.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (SourceReaderBase.java:338) Closing Source Reader.
12:16:55.265 [WARN - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29662), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [12ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [12ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [27ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [222ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2761ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@2050014109(state=PENDING, result=null, callback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571), errback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.254:37603
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:55.265 [INFO - Source: KuduSource -> Sink: Writer (2/4)#3] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#3 (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3).
12:16:55.267 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#3 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
12:16:55.270 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3) switched from INITIALIZING to FAILED on ced9c8a0-7afc-4165-a679-8d909c5af9eb @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=29662), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [4ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [12ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [12ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [25ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [27ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [27ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [42ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [43ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [61ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [61ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [81ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [81ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [101ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [102ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [102ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [142ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [142ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [161ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [162ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [162ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [221ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [222ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [222ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [1121ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [1121ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2760ms] refreshing cache from master, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2760ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.253:43339: Network error: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.254:37603: Network error: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603, [2761ms] Sub RPC ConnectToMaster: received response from server master-127.17.135.252:38447: Network error: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2761ms] delaying RPC due to: Service unavailable: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.253:43339, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.254:37603, [2801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.17.135.252:38447, [2801ms] too many traces: truncated at 100 traces, deferred=Deferred@2050014109(state=PENDING, result=null, callback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571), errback=(continuation of Deferred@1694977774 after retry RPC after error@201235618) -> (continuation of Deferred@811945517 after retry RPC after error@1341585391) -> (continuation of Deferred@274313409 after retry RPC after error@1866282468) -> (continuation of Deferred@1966283272 after retry RPC after error@226673358) -> (continuation of Deferred@1342219271 after retry RPC after error@1452550646) -> (continuation of Deferred@991599222 after retry RPC after error@546683753) -> (continuation of Deferred@1977615328 after retry RPC after error@46944051) -> (continuation of Deferred@1844100150 after retry RPC after error@1613302801) -> (continuation of Deferred@363064567 after retry RPC after error@1979096231) -> (continuation of Deferred@1304794403 after retry RPC after error@1696878862) -> (continuation of Deferred@1869274377 after retry RPC after error@783837159) -> (continuation of Deferred@1337299870 after retry RPC after error@148768583) -> (continuation of Deferred@828707264 after retry RPC after error@1552928596) -> (continuation of Deferred@1069911608 after retry RPC after error@1205424824) -> (continuation of Deferred@1579921554 after retry RPC after error@2096902508) -> (continuation of Deferred@1868289157 after retry RPC after error@1645877060) -> (continuation of Deferred@1630962869 after retry RPC after error@2086448814) -> (continuation of Deferred@1301455452 after retry RPC after error@2130721949) -> (continuation of Deferred@717622500 after retry RPC after error@863432396) -> (continuation of Deferred@1798187708 after retry RPC after error@364119952) -> (continuation of Deferred@261069038 after retry RPC after error@185276253) -> (continuation of Deferred@300595018 after retry RPC after error@609729120) -> (continuation of Deferred@1466703596 after retry RPC after error@68049571)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.17.135.254:37603
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:55.271 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task 235edac217b8d0dd9e42748196a1ed51_cbc357ccb763df2852fee8c4fc7d55f2_1_3.
12:16:55.271 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5184ffe83187ccec3ebfd9d613debdde) switched from state RUNNING to RESTARTING.
12:16:55.272 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5184ffe83187ccec3ebfd9d613debdde: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:55.272 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#3) of source Source: KuduSource.
12:16:55.294 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.296 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:55.296 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:55.296 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:55.297 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.297 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.297 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.297 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.297 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.297 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.297 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.297 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.297 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.297 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:55.310 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513015310 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:55.314 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:55.314 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:55.314 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:55.314 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.315 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.315 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.315 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.315 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:55.323 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 4 for job a80b2d6bcff6a8f46968361f50aad224 (1968 bytes, checkpointDuration=12 ms, finalizationTime=1 ms).
12:16:55.324 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 4 as completed for source Source: KuduSource.
12:16:55.325 [DEBUG - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:261) Checkpoint 4 complete: removed split 32951798cacd0d392560515b1eeb92c50691f2cab7e8a7e985dceaa99043fed6 from pending
12:16:55.325 [INFO - SourceCoordinator-Source: KuduSource] (MetricWrappedKuduEnumerator.java:266) Checkpoint 4 complete: removed 1 finished splits from enumerator state
12:16:55.360 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:55.360 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:55.361 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:55.361 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.361 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.361 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.361 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.361 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.361 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:55.361 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:55.361 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:55.361 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:55.393 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:55.393 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:55.393 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:55.393 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.393 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.393 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:55.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:55.394 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:55.394 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:55.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.460 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:55.460 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:55.461 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:55.461 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:55.461 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:55.461 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:55.461 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:55.461 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:55.462 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:55.461 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:55.462 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:55.462 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:55.462 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:55.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:55.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:55.554 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:55.555 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:55.555 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:55.555 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:55.555 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:55.555 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:55.555 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:55.555 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:55.555 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:55.556 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:55.556 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:55.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.643 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.794 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 6b98bc975be284725b662aff85b5faa8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 6b98bc975be284725b662aff85b5faa8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.811 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513015810 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:55.830 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 5 for job a80b2d6bcff6a8f46968361f50aad224 (964 bytes, checkpointDuration=20 ms, finalizationTime=0 ms).
12:16:55.831 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 5 as completed for source Source: KuduSource.
12:16:55.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:55Z chronyd exiting
12:16:55.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:55.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:55.917 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:55.917 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:55.917 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:55.918 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:55.918 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:55.918 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:55.918 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:55.918 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:55.918 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:55.918 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:55.918 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:55.923 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:55.923 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:55.923 [DEBUG - pool-462-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:55.924 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:55.924 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:55.924 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:55.924 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:55.924 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:55.924 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:55.924 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:55.924 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:55.924 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:55.925 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:55.925 [DEBUG - kudu-nio-5] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [36ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [71ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4800ms] refreshing cache from master, [4800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4801ms] too many traces: truncated at 100 traces, deferred=Deferred@853942093(state=PENDING, result=null, callback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998), errback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998)))
12:16:55.926 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
12:16:55.926 [WARN - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [36ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [71ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4800ms] refreshing cache from master, [4800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4801ms] too many traces: truncated at 100 traces, deferred=Deferred@853942093(state=PENDING, result=null, callback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998), errback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:55.926 [INFO - Source: KuduSource -> Sink: Writer (3/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7).
12:16:55.929 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#7 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
12:16:55.931 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (3/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=26910), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [35ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [35ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [36ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [36ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [70ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [71ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [81ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [103ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [144ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [145ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [145ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] refreshing cache from master, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [226ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [243ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [243ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [460ms] refreshing cache from master, [460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [461ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [462ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [861ms] refreshing cache from master, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [862ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [862ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1241ms] refreshing cache from master, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1242ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1242ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4800ms] refreshing cache from master, [4800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4801ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4801ms] too many traces: truncated at 100 traces, deferred=Deferred@853942093(state=PENDING, result=null, callback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998), errback=(continuation of Deferred@1328508810 after retry RPC after error@255910227) -> (continuation of Deferred@1748606982 after retry RPC after error@1789384251) -> (continuation of Deferred@1589688282 after retry RPC after error@1451396904) -> (continuation of Deferred@1939745902 after retry RPC after error@668744232) -> (continuation of Deferred@2096703342 after retry RPC after error@1044388886) -> (continuation of Deferred@1010809580 after retry RPC after error@2062867001) -> (continuation of Deferred@1334001758 after retry RPC after error@1897747732) -> (continuation of Deferred@817133825 after retry RPC after error@1817008188) -> (continuation of Deferred@957965403 after retry RPC after error@582431641) -> (continuation of Deferred@836250303 after retry RPC after error@928122880) -> (continuation of Deferred@1159436557 after retry RPC after error@1579897292) -> (continuation of Deferred@785782116 after retry RPC after error@165878454) -> (continuation of Deferred@271133046 after retry RPC after error@336113550) -> (continuation of Deferred@174843230 after retry RPC after error@466384911) -> (continuation of Deferred@1115132057 after retry RPC after error@324154246) -> (continuation of Deferred@1179018663 after retry RPC after error@1051877728) -> (continuation of Deferred@1086315895 after retry RPC after error@1123227877) -> (continuation of Deferred@938292801 after retry RPC after error@444201149) -> (continuation of Deferred@613669600 after retry RPC after error@2130565799) -> (continuation of Deferred@545043463 after retry RPC after error@1972702373) -> (continuation of Deferred@1332448301 after retry RPC after error@1607683973) -> (continuation of Deferred@441058548 after retry RPC after error@1206371132) -> (continuation of Deferred@1425945865 after retry RPC after error@286582644) -> (continuation of Deferred@1538472966 after retry RPC after error@582281839) -> (continuation of Deferred@130536781 after retry RPC after error@836676998)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:55.931 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#7) of source Source: KuduSource.
12:16:55.932 [INFO - flink-pekko.actor.default-dispatcher-4] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:55.937 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_2_7.
12:16:55.938 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (6b98bc975be284725b662aff85b5faa8) switched from state RUNNING to RESTARTING.
12:16:55.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:55.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.001 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:56.001 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:56.001 [DEBUG - pool-460-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:56.001 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.002 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.002 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.002 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.002 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.002 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.002 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.002 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.002 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.002 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:56.003 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27013), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [126ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [130ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [147ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [150ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [150ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [160ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2020ms] refreshing cache from master, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2022ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4720ms] refreshing cache from master, [4720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4721ms] too many traces: truncated at 100 traces, deferred=Deferred@671546620(state=PENDING, result=null, callback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830), errback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830)))
12:16:56.004 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
12:16:56.004 [WARN - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27013), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [126ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [130ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [147ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [150ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [150ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [160ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2020ms] refreshing cache from master, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2022ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4720ms] refreshing cache from master, [4720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4721ms] too many traces: truncated at 100 traces, deferred=Deferred@671546620(state=PENDING, result=null, callback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830), errback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:56.004 [INFO - Source: KuduSource -> Sink: Writer (2/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7).
12:16:56.006 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#7 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
12:16:56.008 [INFO - flink-pekko.actor.default-dispatcher-7] (Execution.java:1449) Source: KuduSource -> Sink: Writer (2/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=27013), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [56ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [123ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [126ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [130ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [131ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [147ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [148ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [150ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [150ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [160ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [182ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [222ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [223ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [223ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [321ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [322ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [482ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [482ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [501ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [502ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [502ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [981ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [982ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [983ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2020ms] refreshing cache from master, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2021ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2022ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2022ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [4720ms] refreshing cache from master, [4720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [4721ms] too many traces: truncated at 100 traces, deferred=Deferred@671546620(state=PENDING, result=null, callback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830), errback=(continuation of Deferred@1288474726 after retry RPC after error@105431739) -> (continuation of Deferred@108130288 after retry RPC after error@420414174) -> (continuation of Deferred@828960313 after retry RPC after error@1903538101) -> (continuation of Deferred@2020786180 after retry RPC after error@420095014) -> (continuation of Deferred@1868896280 after retry RPC after error@867244614) -> (continuation of Deferred@1563270868 after retry RPC after error@357476931) -> (continuation of Deferred@1387058474 after retry RPC after error@1777636883) -> (continuation of Deferred@1478393543 after retry RPC after error@946002741) -> (continuation of Deferred@206789782 after retry RPC after error@1104811777) -> (continuation of Deferred@1788453307 after retry RPC after error@1141662894) -> (continuation of Deferred@1378694997 after retry RPC after error@1130254350) -> (continuation of Deferred@1684907431 after retry RPC after error@1130599568) -> (continuation of Deferred@2018481206 after retry RPC after error@1235252497) -> (continuation of Deferred@1089057055 after retry RPC after error@527530630) -> (continuation of Deferred@454796154 after retry RPC after error@1373197813) -> (continuation of Deferred@1547003800 after retry RPC after error@1216644050) -> (continuation of Deferred@239270347 after retry RPC after error@355427083) -> (continuation of Deferred@1657921425 after retry RPC after error@237459978) -> (continuation of Deferred@389183140 after retry RPC after error@2045470834) -> (continuation of Deferred@355081609 after retry RPC after error@568980012) -> (continuation of Deferred@627718115 after retry RPC after error@132150212) -> (continuation of Deferred@1122234596 after retry RPC after error@745869830)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.60:40605
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:56.009 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:56.009 [INFO - flink-pekko.actor.default-dispatcher-7] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_1_7.
12:16:56.009 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#7) of source Source: KuduSource.
12:16:56.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.308 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:56.309 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:56.309 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:56.309 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.309 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.309 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.309 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.309 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.309 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.309 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.309 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.309 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.310 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:56.310 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:56.310 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:56.310 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:56.310 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.310 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.310 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:56.310 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.310 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.310 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:56.310 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.311 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.311 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:56.311 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:56.311 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513016310 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:56.319 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:56.320 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:56.320 [DEBUG - pool-498-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:56.320 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.320 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.320 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.320 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.320 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.320 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.320 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.320 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.321 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.321 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:56.321 [INFO - jobmanager-io-thread-2] (CheckpointCoordinator.java:1440) Completed checkpoint 6 for job a80b2d6bcff6a8f46968361f50aad224 (964 bytes, checkpointDuration=11 ms, finalizationTime=0 ms).
12:16:56.322 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 6 as completed for source Source: KuduSource.
12:16:56.374 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:56.374 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:56.374 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:56.375 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.375 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.375 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.375 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.375 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.375 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.375 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.375 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.375 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.375 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:56.409 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:56.410 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:56.410 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:56.410 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:56.410 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:56.410 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:56.410 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:56.410 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:56.410 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:56.410 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:56.410 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:56.410 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:56.410 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:56.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.468 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.602 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:56.602 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:56.602 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:56.603 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:56.603 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:56.603 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:56.603 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:56.603 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:56.603 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:56.604 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:56.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:56.604 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:56.604 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:56.608 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:56.608 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:56.609 [DEBUG - pool-492-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:56.609 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.609 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.609 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:56.609 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.609 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.609 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:56.609 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.609 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.609 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:56.609 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:56.613 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.188:40821(127.21.224.188:40821)] connecting to peer
12:16:56.613 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.190:35543(127.21.224.190:35543)] connecting to peer
12:16:56.613 [DEBUG - pool-488-thread-1] (Connection.java:748) [peer master-127.21.224.189:39039(127.21.224.189:39039)] connecting to peer
12:16:56.613 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:56.613 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.21.224.188:40821(127.21.224.188:40821)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:56.613 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.188:40821: Failed to connect to peer master-127.21.224.188:40821(127.21.224.188:40821): Connection refused: /127.21.224.188:40821
12:16:56.614 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:56.614 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.21.224.190:35543(127.21.224.190:35543)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:56.614 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.190:35543: Failed to connect to peer master-127.21.224.190:35543(127.21.224.190:35543): Connection refused: /127.21.224.190:35543
12:16:56.614 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:56.614 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.21.224.189:39039(127.21.224.189:39039)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:56.614 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.21.224.189:39039: Failed to connect to peer master-127.21.224.189:39039(127.21.224.189:39039): Connection refused: /127.21.224.189:39039
12:16:56.614 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.21.224.188:40821,127.21.224.190:35543,127.21.224.189:39039; will retry
12:16:56.642 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.794 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:56.794 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:56.794 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:56.795 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.795 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.795 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.795 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:56.795 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.795 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.795 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:56.795 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.795 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:56.795 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:56.811 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513016810 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:56.822 [INFO - jobmanager-io-thread-4] (CheckpointCoordinator.java:1440) Completed checkpoint 7 for job a80b2d6bcff6a8f46968361f50aad224 (964 bytes, checkpointDuration=12 ms, finalizationTime=0 ms).
12:16:56.824 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 7 as completed for source Source: KuduSource.
12:16:56.950 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:56.979 [DEBUG - main] (Connection.java:575) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] disconnecting while in state READY
12:16:56.979 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.126:40817(127.23.110.126:40817)] disconnecting while in state READY
12:16:56.979 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.125:35201(127.23.110.125:35201)] disconnecting while in state READY
12:16:56.979 [DEBUG - main] (Connection.java:575) [peer master-127.23.110.124:37703(127.23.110.124:37703)] disconnecting while in state READY
12:16:56.980 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] handling channelInactive
12:16:56.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] cleaning up while in state READY due to: connection closed
12:16:56.980 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.110.125:35201(127.23.110.125:35201)] handling channelInactive
12:16:56.980 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:56.980 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state READY due to: connection closed
12:16:56.984 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-2
12:16:56.984 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-3
12:16:56.980 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.110.126:40817(127.23.110.126:40817)] handling channelInactive
12:16:56.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state READY due to: connection closed
12:16:56.985 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:56.986 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.110.124:37703(127.23.110.124:37703)] handling channelInactive
12:16:56.986 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state READY due to: connection closed
12:16:56.986 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 27 thread-local buffer(s) from thread: kudu-nio-0
12:16:56.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:56.987159 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24305
12:16:57.018 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 09fae4b8cefe4dd08bb11f2ef4be861e
12:16:57.021 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:308) Adding split(s) to reader: [KuduSourceSplit{splitId='ba90974c6a67279b8af81db924a912e64cdc457935f96a7a142a7c4d835adf79'}]
12:16:57.022 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:16:57.024 [INFO - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:115) Starting split fetcher 0
12:16:57.025 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=296040, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:57.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:57.031785 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24443
12:16:57.034 [DEBUG - Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:748) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] connecting to peer
12:16:57.056 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.057 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] cleaning up while in state CONNECTING due to: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.057 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:57.062058 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24697
12:16:57.074 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)] connecting to peer
12:16:57.086 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.086 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)] cleaning up while in state CONNECTING due to: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.086 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.094 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] connecting to peer
12:16:57.095 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] Successfully connected to peer
12:16:57.097 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:57.097 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:57.097 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:57.097 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:57.097 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:57.097 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:57.097 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:57.097 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:57.097 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:57.097 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:57.098 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:57.098 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:57.098 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:57.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.102 [ERROR - kudu-nio-2] (Connection.java:452) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] unexpected exception from downstream on [id: 0x7665d57e, L:/127.0.0.1:53422 - R:/127.23.110.67:40905]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.102 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] cleaning up while in state NEGOTIATING due to: [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] unexpected exception from downstream on [id: 0x7665d57e, L:/127.0.0.1:53422 - R:/127.23.110.67:40905]
12:16:57.102 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] unexpected exception from downstream on [id: 0x7665d57e, L:/127.0.0.1:53422 - R:/127.23.110.67:40905]
12:16:57.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:57.102607 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24008
12:16:57.103 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] handling channelInactive
12:16:57.114 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.114 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.115 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.23.110.124:37703(127.23.110.124:37703)] Successfully connected to peer
12:16:57.116 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.116 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.23.110.126:40817(127.23.110.126:40817)] Successfully connected to peer
12:16:57.116 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.23.110.125:35201(127.23.110.125:35201)] Successfully connected to peer
12:16:57.123 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.124
12:16:57.123 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.110.125
12:16:57.130 [DEBUG - kudu-nio-3] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:57.130 [DEBUG - kudu-nio-5] (SslHandler.java:1993) [id: 0xembedded, L:embedded - R:embedded] HANDSHAKEN: protocol:TLSv1.3 cipher suite:TLS_AES_128_GCM_SHA256
12:16:57.132 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xd6b54bd7, L:/127.0.0.1:47954 - R:/127.23.110.125:35201] using SASL/PLAIN
12:16:57.133 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x234647b6, L:/127.0.0.1:52846 - R:/127.23.110.124:37703] using SASL/PLAIN
12:16:57.136 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:16:57.136 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=null, attempt=1, TimeoutTracker(timeout=29912, elapsed=22), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.124:37703, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.126:40817, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.125:35201, [21ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.125:35201: OK, [22ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.124:37703: OK, deferred=null) after lookup
12:16:57.137 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.110.126:40817(127.23.110.126:40817)] handling channelInactive
12:16:57.137 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state READY due to: connection closed
12:16:57.138 [ERROR - kudu-nio-4] (Connection.java:452) [peer master-127.23.110.126:40817(127.23.110.126:40817)] unexpected exception from downstream on [id: 0x5a3a2706, L:/127.0.0.1:55030 - R:/127.23.110.126:40817]
java.net.SocketException: Connection reset
	at java.base/sun.nio.ch.SocketChannelImpl.throwConnectionReset(SocketChannelImpl.java:394)
	at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:426)
	at org.apache.kudu.shaded.io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:255)
	at org.apache.kudu.shaded.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1132)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:356)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:156)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:796)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.138 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state NEGOTIATING due to: [peer master-127.23.110.126:40817(127.23.110.126:40817)] unexpected exception from downstream on [id: 0x5a3a2706, L:/127.0.0.1:55030 - R:/127.23.110.126:40817]
12:16:57.138 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: [peer master-127.23.110.126:40817(127.23.110.126:40817)] unexpected exception from downstream on [id: 0x5a3a2706, L:/127.0.0.1:55030 - R:/127.23.110.126:40817]
12:16:57.138 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.23.110.126:40817(127.23.110.126:40817)] handling channelInactive
12:16:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:57.139406 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24078
12:16:57.142 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.142 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2538) Learned about tablet 4823348c082a4b7e9ba31b93b4a21b4c for table 'replication_test_table' with partition [<start>, <end>)
12:16:57.142 [DEBUG - kudu-nio-3] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4823348c082a4b7e9ba31b93b4a21b4c@[0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)[L],2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335),45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)]}]
12:16:57.143 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=4823348c082a4b7e9ba31b93b4a21b4c, attempt=4, KuduRpc(method=Scan, tablet=4823348c082a4b7e9ba31b93b4a21b4c, attempt=4, TimeoutTracker(timeout=30000, elapsed=117), Traces: [0ms] sending RPC to server 2bf29054a41a4a2988efd660ec5f186f, [24ms] received response from server 2bf29054a41a4a2988efd660ec5f186f: Network error: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335, [24ms] delaying RPC due to: Network error: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335, [41ms] sending RPC to server 45bf22799a184117b4ce3874e955f2af, [53ms] received response from server 45bf22799a184117b4ce3874e955f2af: Network error: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115, [53ms] delaying RPC due to: Network error: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115, [61ms] sending RPC to server 0d4e99b44aa74c38b7d6bd2b759602a4, [69ms] received response from server 0d4e99b44aa74c38b7d6bd2b759602a4: Network error: [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] unexpected exception from downstream on [id: 0x7665d57e, L:/127.0.0.1:53422 - R:/127.23.110.67:40905], [69ms] delaying RPC due to: Network error: [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] unexpected exception from downstream on [id: 0x7665d57e, L:/127.0.0.1:53422 - R:/127.23.110.67:40905], [81ms] refreshing cache from master, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.124:37703, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.126:40817, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.110.125:35201, [102ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.125:35201: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.124:37703: OK, [104ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.110.124:37703, [105ms] Sub RPC ConnectToMaster: received response from server master-127.23.110.126:40817: Network error: [peer master-127.23.110.126:40817(127.23.110.126:40817)] unexpected exception from downstream on [id: 0x5a3a2706, L:/127.0.0.1:55030 - R:/127.23.110.126:40817], [109ms] Sub RPC GetTableLocations: received response from server master-127.23.110.124:37703: OK, deferred=Deferred@841702948(state=PENDING, result=null, callback=scanner opened -> passthrough -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0, errback=passthrough -> open scanner errback -> wakeup thread Source Data Fetcher for Source: KuduSource -> Sink: Writer (4/4)#0))) after lookup
12:16:57.143 [DEBUG - kudu-nio-3] (Connection.java:748) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] connecting to peer
12:16:57.145 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:57.145 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:57.145 [DEBUG - pool-482-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:57.145 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.145 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.145 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.146 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.146 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.146 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.146 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.146 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:57.159 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.159 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335)] cleaning up while in state CONNECTING due to: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.159 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: Failed to connect to peer 2bf29054a41a4a2988efd660ec5f186f(127.23.110.65:42335): Connection refused: /127.23.110.65:42335
12:16:57.172 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.110.125:35201(127.23.110.125:35201)] handling channelInactive
12:16:57.172 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state READY due to: connection closed
12:16:57.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:16:57.173575 23993 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskgjdPqB/build/tsan/bin/kudu with pid 24154
12:16:57.174 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)] connecting to peer
12:16:57.175 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.175 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115)] cleaning up while in state CONNECTING due to: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.176 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: Failed to connect to peer 45bf22799a184117b4ce3874e955f2af(127.23.110.66:33115): Connection refused: /127.23.110.66:33115
12:16:57.172 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.23.110.125:35201(127.23.110.125:35201)] handling channelInactive
12:16:57.176 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state READY due to: connection closed
12:16:57.180 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.253:43339(127.17.135.253:43339)] connecting to peer
12:16:57.180 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.254:37603(127.17.135.254:37603)] connecting to peer
12:16:57.180 [DEBUG - pool-520-thread-1] (Connection.java:748) [peer master-127.17.135.252:38447(127.17.135.252:38447)] connecting to peer
12:16:57.181 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:57.181 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:57.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.17.135.254:37603(127.17.135.254:37603)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:57.181 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.17.135.253:43339(127.17.135.253:43339)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:57.181 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:57.181 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.253:43339: Failed to connect to peer master-127.17.135.253:43339(127.17.135.253:43339): Connection refused: /127.17.135.253:43339
12:16:57.181 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.17.135.252:38447(127.17.135.252:38447)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:57.181 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.254:37603: Failed to connect to peer master-127.17.135.254:37603(127.17.135.254:37603): Connection refused: /127.17.135.254:37603
12:16:57.181 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.17.135.252:38447: Failed to connect to peer master-127.17.135.252:38447(127.17.135.252:38447): Connection refused: /127.17.135.252:38447
12:16:57.181 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.17.135.253:43339,127.17.135.254:37603,127.17.135.252:38447; will retry
12:16:57.202 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.23.110.124:37703(127.23.110.124:37703)] handling channelInactive
12:16:57.202 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state READY due to: connection closed
12:16:57.202 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.110.124:37703(127.23.110.124:37703)] handling channelInactive
12:16:57.202 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state READY due to: connection closed
12:16:57.214 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] connecting to peer
12:16:57.215 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905): Connection refused: /127.23.110.67:40905
12:16:57.215 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905): Connection refused: /127.23.110.67:40905
12:16:57.215 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905) for tablet 4823348c082a4b7e9ba31b93b4a21b4c: Failed to connect to peer 0d4e99b44aa74c38b7d6bd2b759602a4(127.23.110.67:40905): Connection refused: /127.23.110.67:40905
12:16:57.264 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:57.265 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:57.265 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:57.265 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.265 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.265 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.265 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.265 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.265 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.265 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.266 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.266 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.266 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:57.274 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.274 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.275 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.23.110.124:37703(127.23.110.124:37703) for tablet Kudu Master: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.294 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.295 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.295 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.295 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.295 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.295 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.295 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.295 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.295 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.295 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.295 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.295 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.296 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.311 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513017310 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:57.314 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.314 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.314 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.315 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.315 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.315 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.315 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.315 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.315 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.316 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.316 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.316 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.316 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.319 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 8 for job a80b2d6bcff6a8f46968361f50aad224 (1968 bytes, checkpointDuration=8 ms, finalizationTime=1 ms).
12:16:57.320 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 8 as completed for source Source: KuduSource.
12:16:57.334 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.334 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.334 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.334 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.334 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.334 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.334 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.334 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.334 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.334 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.335 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.334 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.335 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.354 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.355 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.355 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.355 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.355 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.355 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.355 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.355 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.355 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.355 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.355 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.355 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.355 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.374 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.374 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.374 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.374 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.374 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.374 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.374 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.374 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.374 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.374 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.374 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.374 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.374 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.393 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.394 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.394 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.394 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.394 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.394 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.394 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.394 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.394 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.394 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.394 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.394 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.394 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.450 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.534 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.534 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.534 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.534 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.534 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.535 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.535 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.535 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.535 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.535 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.535 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.535 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.535 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.554 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.554 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.554 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.554 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.554 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.555 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.555 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.555 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.555 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.555 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.555 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.555 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.555 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.599 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.603 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:57.604 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:57.604 [DEBUG - pool-464-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:57.604 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.604 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.604 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.604 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.604 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.604 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.604 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.604 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.604 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.604 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:57.641 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 5273b45840e0da6e6ca30141a2a11dd8 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 5273b45840e0da6e6ca30141a2a11dd8 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.646 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.254:35497(127.12.238.254:35497)] connecting to peer
12:16:57.646 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.252:39469(127.12.238.252:39469)] connecting to peer
12:16:57.646 [DEBUG - pool-490-thread-1] (Connection.java:748) [peer master-127.12.238.253:35475(127.12.238.253:35475)] connecting to peer
12:16:57.647 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:57.647 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:57.647 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.238.254:35497(127.12.238.254:35497)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:57.647 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.238.252:39469(127.12.238.252:39469)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:57.647 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:57.647 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.252:39469: Failed to connect to peer master-127.12.238.252:39469(127.12.238.252:39469): Connection refused: /127.12.238.252:39469
12:16:57.647 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.254:35497: Failed to connect to peer master-127.12.238.254:35497(127.12.238.254:35497): Connection refused: /127.12.238.254:35497
12:16:57.647 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.238.253:35475(127.12.238.253:35475)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:57.647 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.238.253:35475: Failed to connect to peer master-127.12.238.253:35475(127.12.238.253:35475): Connection refused: /127.12.238.253:35475
12:16:57.647 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.238.254:35497,127.12.238.252:39469,127.12.238.253:35475; will retry
12:16:57.674 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:57.674 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:57.674 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:57.674 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.675 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.675 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:57.675 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.675 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.675 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.675 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.675 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:57.675 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:57.675 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:57.703 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:57.703 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:57.703 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:57.703 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:57.703 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:57.703 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:57.703 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:57.704 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:57.703 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:57.704 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:57.704 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:57.704 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:57.704 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:57.704 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:57.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.704 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.704 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.704 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.704 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:57.704 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.704 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.704 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.704 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:57.704 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.704 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.704 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:57.810 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513017809 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:57.817 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 9 for job a80b2d6bcff6a8f46968361f50aad224 (1968 bytes, checkpointDuration=8 ms, finalizationTime=0 ms).
12:16:57.818 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 9 as completed for source Source: KuduSource.
12:16:57.909 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.61:39401(127.11.220.61:39401)] connecting to peer
12:16:57.910 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.62:34269(127.11.220.62:34269)] connecting to peer
12:16:57.910 [DEBUG - pool-458-thread-1] (Connection.java:748) [peer master-127.11.220.60:40605(127.11.220.60:40605)] connecting to peer
12:16:57.910 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.910 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.910 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.220.60:40605(127.11.220.60:40605)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.910 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.220.61:39401(127.11.220.61:39401)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.910 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.60:40605: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605
12:16:57.910 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.61:39401: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401
12:16:57.910 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.910 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.220.62:34269(127.11.220.62:34269)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.910 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.220.62:34269: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
12:16:57.910 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605; will retry
12:16:57.911 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [91ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [92ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [93ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [93ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [465ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [962ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1382ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2482ms] too many traces: truncated at 100 traces, deferred=Deferred@80119333(state=PENDING, result=null, callback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653), errback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653)))
12:16:57.912 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
12:16:57.912 [WARN - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:1117) Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED with failure cause:
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [91ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [92ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [93ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [93ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [465ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [962ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1382ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2482ms] too many traces: truncated at 100 traces, deferred=Deferred@80119333(state=PENDING, result=null, callback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653), errback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.912 [INFO - Source: KuduSource -> Sink: Writer (1/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7).
12:16:57.914 [INFO - flink-pekko.actor.default-dispatcher-8] (TaskExecutor.java:2037) Un-registering task and sending final execution state FAILED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#7 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
12:16:57.916 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1449) Source: KuduSource -> Sink: Writer (1/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7) switched from INITIALIZING to FAILED on acb06fe1-d887-4b4f-977e-ab286ef66b41 @ 127.0.0.1 (dataPort=-1).
org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=28939), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [4ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [69ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [91ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [92ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [93ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [93ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [102ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [121ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [142ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [161ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [181ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [182ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [464ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [465ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [466ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [466ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [961ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [962ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [962ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1380ms] refreshing cache from master, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1381ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1382ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1641ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [1642ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [1643ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2481ms] refreshing cache from master, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2482ms] too many traces: truncated at 100 traces, deferred=Deferred@80119333(state=PENDING, result=null, callback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653), errback=(continuation of Deferred@977843398 after retry RPC after error@1714119770) -> (continuation of Deferred@1932614469 after retry RPC after error@1131809960) -> (continuation of Deferred@1021804164 after retry RPC after error@30659830) -> (continuation of Deferred@2025938170 after retry RPC after error@195103750) -> (continuation of Deferred@204816552 after retry RPC after error@324944316) -> (continuation of Deferred@1628109217 after retry RPC after error@1657280698) -> (continuation of Deferred@1155413067 after retry RPC after error@636280525) -> (continuation of Deferred@329120800 after retry RPC after error@825375521) -> (continuation of Deferred@75185440 after retry RPC after error@1201832404) -> (continuation of Deferred@992086524 after retry RPC after error@468305546) -> (continuation of Deferred@1176926954 after retry RPC after error@366604251) -> (continuation of Deferred@1042250101 after retry RPC after error@1796683178) -> (continuation of Deferred@504623880 after retry RPC after error@1156472870) -> (continuation of Deferred@33516831 after retry RPC after error@1394057967) -> (continuation of Deferred@1377665078 after retry RPC after error@1707422979) -> (continuation of Deferred@522730289 after retry RPC after error@1900471009) -> (continuation of Deferred@1340391631 after retry RPC after error@63281437) -> (continuation of Deferred@1567280103 after retry RPC after error@461204289) -> (continuation of Deferred@1920344665 after retry RPC after error@1574195323) -> (continuation of Deferred@1449823701 after retry RPC after error@641581882) -> (continuation of Deferred@1704610126 after retry RPC after error@447908366) -> (continuation of Deferred@414496936 after retry RPC after error@1347984535) -> (continuation of Deferred@1740603371 after retry RPC after error@1767074792) -> (continuation of Deferred@1411379090 after retry RPC after error@1077378466) -> (continuation of Deferred@1558905448 after retry RPC after error@773140022) -> (continuation of Deferred@98379545 after retry RPC after error@2122092653)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.tableExists(KuduClient.java:327)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.obtainTable(KuduWriter.java:142)
	at org.apache.flink.connector.kudu.connector.writer.KuduWriter.<init>(KuduWriter.java:77)
	at org.apache.flink.connector.kudu.sink.KuduSink.createWriter(KuduSink.java:67)
	at org.apache.flink.api.connector.sink2.Sink.createWriter(Sink.java:77)
	at org.apache.flink.streaming.runtime.operators.sink.StatelessSinkWriterStateHandler.createWriter(StatelessSinkWriterStateHandler.java:39)
	at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.initializeState(SinkWriterOperator.java:163)
	at org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:134)
	at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286)
	at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreStateAndGates(StreamTask.java:799)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$restoreInternal$3(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:753)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:712)
	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958)
	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:751)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.base/java.lang.Thread.run(Thread.java:840)
	Suppressed: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
		... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	... 1 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.flink.util.SerializedThrowable: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.220.62:34269
Caused by: org.apache.flink.util.SerializedThrowable: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.917 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 6b98bc975be284725b662aff85b5faa8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:57.917 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#7) of source Source: KuduSource.
12:16:57.917 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:352) 1 tasks will be restarted to recover the failed task f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_0_7.
12:16:57.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:57.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:57.925 [DEBUG - pool-485-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:57.926 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.926 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.926 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:57.926 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.926 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.926 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.926 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.926 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:57.926 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:57.926 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:57.950 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.969 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:57.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:57.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:57.974 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:57.974 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.974 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.974 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.974 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.975 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.975 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.975 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.975 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.975 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.975 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:57.975 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27798), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [72ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [76ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [76ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [179ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [186ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [186ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [224ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [224ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [225ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [323ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [323ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [382ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [901ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [902ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1222ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2503ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1434009584(state=PENDING, result=null, callback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511), errback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511)))
12:16:57.976 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:57.976 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:57.976 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:57.976 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.976 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.976 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27798), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [72ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [76ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [76ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [179ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [186ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [186ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [224ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [224ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [225ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [323ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [323ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [382ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [901ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [902ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1222ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2503ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1434009584(state=PENDING, result=null, callback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511), errback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27798), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [72ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [76ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [76ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [179ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [186ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [186ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [224ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [224ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [225ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [323ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [323ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [382ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [901ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [902ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1222ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2503ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1434009584(state=PENDING, result=null, callback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511), errback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.126:41267
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.976 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.976 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.977 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.976 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.976 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.977 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.977 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.977 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:57.981 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27798), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [72ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [76ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [76ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [179ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [186ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [186ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [224ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [224ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [225ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [323ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [323ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [382ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [901ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [902ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1222ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2503ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1434009584(state=PENDING, result=null, callback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511), errback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=27, TimeoutTracker(timeout=30000, elapsed=27798), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [71ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [72ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [76ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [76ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [141ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [179ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [185ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [185ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [186ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [186ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [224ms] refreshing cache from master, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [224ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [225ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [225ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [321ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [322ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [323ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [323ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [381ms] refreshing cache from master, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [382ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [382ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [520ms] refreshing cache from master, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [521ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [522ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [522ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [901ms] refreshing cache from master, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [901ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [902ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [902ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1220ms] refreshing cache from master, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [1222ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [1222ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2500ms] refreshing cache from master, [2500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [2501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [2501ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.126:41267: Network error: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267, [2502ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.125:34511: Network error: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511, [2503ms] Sub RPC ConnectToMaster: received response from server master-127.19.5.124:34641: Network error: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [2503ms] delaying RPC due to: Service unavailable: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641, [3361ms] refreshing cache from master, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.125:34511, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.124:34641, [3361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.5.126:41267, [3362ms] too many traces: truncated at 100 traces, deferred=Deferred@1434009584(state=PENDING, result=null, callback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511), errback=(continuation of Deferred@164573796 after retry RPC after error@285923408) -> (continuation of Deferred@1877868647 after retry RPC after error@1936991445) -> (continuation of Deferred@64517325 after retry RPC after error@1146610878) -> (continuation of Deferred@1529166187 after retry RPC after error@153484374) -> (continuation of Deferred@1234931619 after retry RPC after error@840097850) -> (continuation of Deferred@1074690418 after retry RPC after error@1718614633) -> (continuation of Deferred@1931253648 after retry RPC after error@1445640953) -> (continuation of Deferred@1708956839 after retry RPC after error@2096733895) -> (continuation of Deferred@1808676575 after retry RPC after error@1748022317) -> (continuation of Deferred@1770529832 after retry RPC after error@1505202296) -> (continuation of Deferred@1138048351 after retry RPC after error@782854356) -> (continuation of Deferred@111714381 after retry RPC after error@1677317296) -> (continuation of Deferred@162280021 after retry RPC after error@1814430844) -> (continuation of Deferred@793738109 after retry RPC after error@37647984) -> (continuation of Deferred@1793643256 after retry RPC after error@909192765) -> (continuation of Deferred@1659973397 after retry RPC after error@328030413) -> (continuation of Deferred@1063135062 after retry RPC after error@10593862) -> (continuation of Deferred@1807988928 after retry RPC after error@309448261) -> (continuation of Deferred@1557868490 after retry RPC after error@1371873665) -> (continuation of Deferred@666273473 after retry RPC after error@1000961940) -> (continuation of Deferred@1049213524 after retry RPC after error@1186487597) -> (continuation of Deferred@1428900789 after retry RPC after error@634295123) -> (continuation of Deferred@1457968804 after retry RPC after error@1387509856) -> (continuation of Deferred@1565140832 after retry RPC after error@206529425) -> (continuation of Deferred@1820120906 after retry RPC after error@599982621) -> (continuation of Deferred@792612898 after retry RPC after error@1486552511)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.19.5.126:41267
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:57.982 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:57.982 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (5273b45840e0da6e6ca30141a2a11dd8) switched from state RUNNING to RESTARTING.
12:16:57.982 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#2) of source Source: KuduSource.
12:16:57.983 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
12:16:57.983 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:16:57.983 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#2) of source Source: KuduSource.
12:16:57.983 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:16:57.983 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
12:16:57.983 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#2) of source Source: KuduSource.
12:16:57.983 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from INITIALIZING to CANCELING.
12:16:57.984 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:16:57.984 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:16:57.984 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#2) of source Source: KuduSource.
12:16:57.985 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:57.985 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:16:57.985 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from INITIALIZING to CANCELING.
12:16:57.985 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:16:57.985 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
12:16:57.985 [INFO - Source: KuduSource -> Sink: Writer (4/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2).
12:16:57.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:57.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:16:57.986 [INFO - Source: KuduSource -> Sink: Writer (3/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2).
12:16:57.991 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:16:57.991 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from INITIALIZING to CANCELING.
12:16:57.991 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:16:57.993 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:57.994 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:57.994 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:57.994 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.994 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.994 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.994 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.994 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.994 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.994 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:57.994 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:57.994 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:57.994 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:57.998 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:57.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
12:16:57.999 [INFO - Source: KuduSource -> Sink: Writer (2/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2).
12:16:57.999 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:16:57.999 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to CANCELING.
12:16:57.999 [INFO - flink-pekko.actor.default-dispatcher-7] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:16:58.000 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (SourceReaderBase.java:338) Closing Source Reader.
12:16:58.000 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:16:58.001 [INFO - Source: KuduSource -> Sink: Writer (1/4)#2] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#2 (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
12:16:58.012 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#2 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2.
12:16:58.012 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#2 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2.
12:16:58.012 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#2 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2.
12:16:58.012 [INFO - flink-pekko.actor.default-dispatcher-7] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#2 555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
12:16:58.013 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_3_2) switched from CANCELING to CANCELED.
12:16:58.013 [INFO - flink-pekko.actor.default-dispatcher-7] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:58.014 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_2_2) switched from CANCELING to CANCELED.
12:16:58.014 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.014 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.014 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_1_2) switched from CANCELING to CANCELED.
12:16:58.014 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.015 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.015 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.015 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (555b759a33406205c8ea45986840a605_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
12:16:58.015 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.015 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.015 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.015 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.015 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.015 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.015 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.015 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.016 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
12:16:58.017 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job 5273b45840e0da6e6ca30141a2a11dd8: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
12:16:58.017 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 5273b45840e0da6e6ca30141a2a11dd8
12:16:58.034 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.034 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.034 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.034 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.034 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.034 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.034 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.034 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.034 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.034 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.035 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.035 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.035 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.053 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.054 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.054 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.054 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.054 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.054 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.054 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.054 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.054 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.054 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.054 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.054 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.054 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:58.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:58.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:58.078 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:58.078 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:58.078 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:58.078 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:58.078 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:58.078 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:58.078 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:58.078 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:58.078 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:58.078 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:58.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.094 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.095 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.095 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.095 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.095 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.095 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.095 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.095 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.095 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.095 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.095 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.099 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:58.114 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.114 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:58.114 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:58.114 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.114 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.114 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.114 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:58.114 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.115 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.115 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.115 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.115 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.115 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.115 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.115 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.115 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.114 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.115 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.115 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.115 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.115 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.115 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.115 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:58.115 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.115 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.117 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:58.117 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:58.117 [DEBUG - pool-496-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:58.118 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.118 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.118 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.118 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.118 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.118 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.118 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.118 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.118 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.118 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:58.133 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.134 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.134 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.134 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.134 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.134 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.134 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.134 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.134 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.134 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.134 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.134 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.134 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.214 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.214 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.214 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.214 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.214 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.215 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.214 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.215 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.215 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.215 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.215 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.215 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.215 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.215 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [74ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [240ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [365ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [365ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [480ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [622ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3242ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6460ms] refreshing cache from master, [6460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6461ms] too many traces: truncated at 100 traces, deferred=Deferred@236832239(state=PENDING, result=null, callback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258), errback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258)))
12:16:58.216 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.216 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.216 [DEBUG - SourceCoordinator-Source: KuduSource-worker-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.216 [ERROR - SourceCoordinator-Source: KuduSource] (SourceCoordinatorContext.java:436) Exception while handling result from async call in SourceCoordinator-Source: KuduSource. Triggering job failover.
org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [74ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [240ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [365ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [365ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [480ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [622ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3242ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6460ms] refreshing cache from master, [6460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6461ms] too many traces: truncated at 100 traces, deferred=Deferred@236832239(state=PENDING, result=null, callback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258), errback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [74ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [240ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [365ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [365ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [480ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [622ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3242ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6460ms] refreshing cache from master, [6460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6461ms] too many traces: truncated at 100 traces, deferred=Deferred@236832239(state=PENDING, result=null, callback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258), errback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.60:33275
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:58.216 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.216 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.216 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.216 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.216 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.216 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.217 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.217 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.217 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.217 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.219 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: KuduSource -> Sink: Writer' (operator cbc357ccb763df2852fee8c4fc7d55f2).
	at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:651)
	at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:248)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:427)
	at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.handleUncaughtExceptionFromAsyncCall(SourceCoordinatorContext.java:440)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:42)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to enumerate Kudu splits, shutting down job.
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.assignSplits(KuduSourceEnumerator.java:215)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$null$4(ExecutorNotifier.java:133)
	at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
	... 6 more
Caused by: java.lang.RuntimeException: Error during incremental diff scan: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [74ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [240ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [365ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [365ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [480ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [622ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3242ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6460ms] refreshing cache from master, [6460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6461ms] too many traces: truncated at 100 traces, deferred=Deferred@236832239(state=PENDING, result=null, callback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258), errback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258)))
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:87)
	at org.apache.flink.connector.kudu.source.enumerator.KuduSourceEnumerator.enumerateNewSplits(KuduSourceEnumerator.java:206)
	at org.apache.flink.runtime.source.coordinator.ExecutorNotifier.lambda$notifyReadyAsync$5(ExecutorNotifier.java:130)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
	... 3 more
Caused by: org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=29182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [42ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [47ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [73ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [74ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [74ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [86ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [86ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [100ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [101ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [101ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [121ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [122ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [122ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [161ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [162ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [162ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [240ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [241ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [363ms] refreshing cache from master, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [364ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [365ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [365ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [480ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [480ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [481ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [481ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [620ms] refreshing cache from master, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [620ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [621ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [622ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [622ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1200ms] refreshing cache from master, [1200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [1201ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [1202ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [1202ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3240ms] refreshing cache from master, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [3240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.61:36393: Network error: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.60:33275: Network error: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275, [3241ms] Sub RPC ConnectToMaster: received response from server master-127.11.38.62:34839: Network error: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [3242ms] delaying RPC due to: Service unavailable: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839, [6460ms] refreshing cache from master, [6460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.61:36393, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.60:33275, [6461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.38.62:34839, [6461ms] too many traces: truncated at 100 traces, deferred=Deferred@236832239(state=PENDING, result=null, callback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258), errback=(continuation of Deferred@688589841 after retry RPC after error@1966283960) -> (continuation of Deferred@289082918 after retry RPC after error@1902740307) -> (continuation of Deferred@15950571 after retry RPC after error@1833466001) -> (continuation of Deferred@617287968 after retry RPC after error@428178929) -> (continuation of Deferred@41590800 after retry RPC after error@744021054) -> (continuation of Deferred@1348901508 after retry RPC after error@1648238476) -> (continuation of Deferred@898849275 after retry RPC after error@1598081627) -> (continuation of Deferred@991349133 after retry RPC after error@700867356) -> (continuation of Deferred@104180574 after retry RPC after error@1602137041) -> (continuation of Deferred@1378442002 after retry RPC after error@1215106248) -> (continuation of Deferred@1672028608 after retry RPC after error@1227042375) -> (continuation of Deferred@1372196282 after retry RPC after error@1902202887) -> (continuation of Deferred@1542248650 after retry RPC after error@191730918) -> (continuation of Deferred@172752876 after retry RPC after error@1909553098) -> (continuation of Deferred@1288100786 after retry RPC after error@736869480) -> (continuation of Deferred@2114617958 after retry RPC after error@77583690) -> (continuation of Deferred@2130609440 after retry RPC after error@134250091) -> (continuation of Deferred@582206655 after retry RPC after error@1484550182) -> (continuation of Deferred@1377909132 after retry RPC after error@1499063941) -> (continuation of Deferred@1702057773 after retry RPC after error@1588979429) -> (continuation of Deferred@84105702 after retry RPC after error@326695437) -> (continuation of Deferred@1816989040 after retry RPC after error@490626258)))
	at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
	at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
	at org.apache.kudu.client.KuduClient.openTable(KuduClient.java:354)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.obtainScanTokenBuilder(KuduSplitGenerator.java:106)
	at org.apache.flink.connector.kudu.source.utils.KuduSplitGenerator.generateIncrementalSplits(KuduSplitGenerator.java:84)
	... 8 more
	Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
		at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
		at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
		at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
		at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
		at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
		at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
		at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
		at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
		at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
		at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
		at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
		at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
		at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
		at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
		at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
		at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
		at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
		at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
		at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
		at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
		... 3 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
	at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
	at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
	at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
	at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:475)
	at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:252)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
	at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
	at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
	at org.apache.kudu.client.Connection$1.operationComplete(Connection.java:762)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:604)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:597)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:573)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:506)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:650)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:643)
	at org.apache.kudu.shaded.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:132)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:326)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:342)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	... 3 more
Caused by: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
	at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:428)
	... 19 more
Caused by: org.apache.kudu.shaded.io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.11.38.60:33275
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:684)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946)
	at org.apache.kudu.shaded.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:336)
	at org.apache.kudu.shaded.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:339)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:784)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:732)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:658)
	at org.apache.kudu.shaded.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at org.apache.kudu.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:998)
	at org.apache.kudu.shaded.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:58.220 [INFO - flink-pekko.actor.default-dispatcher-6] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:58.220 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to CANCELING.
12:16:58.220 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#7) of source Source: KuduSource.
12:16:58.220 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
12:16:58.220 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from INITIALIZING to CANCELING.
12:16:58.220 [INFO - flink-pekko.actor.default-dispatcher-4] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
12:16:58.221 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (SourceReaderBase.java:338) Closing Source Reader.
12:16:58.221 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CANCELING to CANCELED.
12:16:58.222 [INFO - Source: KuduSource -> Sink: Writer (4/4)#7] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (4/4)#7 (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7).
12:16:58.222 [INFO - flink-pekko.actor.default-dispatcher-4] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (4/4)#7 f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7.
12:16:58.223 [INFO - flink-pekko.actor.default-dispatcher-6] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (f1df39072930eae44b7713aa4c84107c_cbc357ccb763df2852fee8c4fc7d55f2_3_7) switched from CANCELING to CANCELED.
12:16:58.223 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:318) Clearing resource requirements of job 6b98bc975be284725b662aff85b5faa8
12:16:58.233 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.234 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.234 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.234 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.234 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.234 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.234 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.234 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.234 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.234 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.234 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.234 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.253 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.254 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.254 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.254 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.254 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.254 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.254 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.254 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.254 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.254 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.254 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:16:58Z chronyd exiting
12:16:58.274 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.274 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.274 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.274 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.274 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.274 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.274 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.274 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.274 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.274 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.274 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.274 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.274 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.293 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.293 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.294 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.294 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.294 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.294 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.294 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.294 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.294 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.294 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.294 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.294 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.294 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.310 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513018309 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:58.314 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.314 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.314 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.314 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.314 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.314 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.314 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.314 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.314 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.314 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.314 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.314 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.315 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.317 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 10 for job a80b2d6bcff6a8f46968361f50aad224 (1968 bytes, checkpointDuration=7 ms, finalizationTime=0 ms).
12:16:58.317 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 10 as completed for source Source: KuduSource.
12:16:58.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.333 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.333 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.333 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.333 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.334 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.334 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.334 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.334 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.334 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.334 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.334 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.354 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.354 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.354 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.354 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.354 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.354 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.354 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.354 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.354 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.355 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.373 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.373 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.373 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.374 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.374 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.374 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.374 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.374 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.374 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.374 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.374 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.374 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.374 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.422 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:58.423 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:58.423 [DEBUG - pool-472-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:58.423 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.423 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.423 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.423 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.423 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.423 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.423 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.423 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.423 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.423 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:58.424 [DEBUG - kudu-nio-7] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=24, TimeoutTracker(timeout=30000, elapsed=28232), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [43ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [47ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [47ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [121ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [132ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [133ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [133ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [133ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [163ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [166ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [166ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [167ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [167ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [182ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [184ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [184ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [242ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [242ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [261ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [282ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [780ms] refreshing cache from master, [780ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [781ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [781ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [782ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [783ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [783ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1680ms] refreshing cache from master, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1681ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1682ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1682ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2180ms] refreshing cache from master, [2180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [2182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2280ms] refreshing cache from master, [2280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2281ms] too many traces: truncated at 100 traces, deferred=Deferred@1516334505(state=PENDING, result=null, callback=(continuation of Deferred@1318733970 after retry RPC after error@516352313) -> (continuation of Deferred@534428680 after retry RPC after error@1317504639) -> (continuation of Deferred@1388681701 after retry RPC after error@2070101413) -> (continuation of Deferred@823391293 after retry RPC after error@1129658398) -> (continuation of Deferred@1025612576 after retry RPC after error@1607276340) -> (continuation of Deferred@1909564140 after retry RPC after error@456061184) -> (continuation of Deferred@711430622 after retry RPC after error@497305361) -> (continuation of Deferred@1637761163 after retry RPC after error@223611721) -> (continuation of Deferred@455840348 after retry RPC after error@612942567) -> (continuation of Deferred@922830053 after retry RPC after error@438439695) -> (continuation of Deferred@1574750053 after retry RPC after error@1059170755) -> (continuation of Deferred@37414062 after retry RPC after error@141216145) -> (continuation of Deferred@859226134 after retry RPC after error@23791618) -> (continuation of Deferred@1419875093 after retry RPC after error@182058577) -> (continuation of Deferred@267041132 after retry RPC after error@1444449163) -> (continuation of Deferred@242848614 after retry RPC after error@1268244366) -> (continuation of Deferred@300691017 after retry RPC after error@62569260) -> (continuation of Deferred@1092287134 after retry RPC after error@881079964) -> (continuation of Deferred@1147852835 after retry RPC after error@316635225) -> (continuation of Deferred@76005014 after retry RPC after error@287459404) -> (continuation of Deferred@52109707 after retry RPC after error@1794087937) -> (continuation of Deferred@1394994372 after retry RPC after error@1346813636) -> (continuation of Deferred@168544830 after retry RPC after error@470958314), errback=(continuation of Deferred@1318733970 after retry RPC after error@516352313) -> (continuation of Deferred@534428680 after retry RPC after error@1317504639) -> (continuation of Deferred@1388681701 after retry RPC after error@2070101413) -> (continuation of Deferred@823391293 after retry RPC after error@1129658398) -> (continuation of Deferred@1025612576 after retry RPC after error@1607276340) -> (continuation of Deferred@1909564140 after retry RPC after error@456061184) -> (continuation of Deferred@711430622 after retry RPC after error@497305361) -> (continuation of Deferred@1637761163 after retry RPC after error@223611721) -> (continuation of Deferred@455840348 after retry RPC after error@612942567) -> (continuation of Deferred@922830053 after retry RPC after error@438439695) -> (continuation of Deferred@1574750053 after retry RPC after error@1059170755) -> (continuation of Deferred@37414062 after retry RPC after error@141216145) -> (continuation of Deferred@859226134 after retry RPC after error@23791618) -> (continuation of Deferred@1419875093 after retry RPC after error@182058577) -> (continuation of Deferred@267041132 after retry RPC after error@1444449163) -> (continuation of Deferred@242848614 after retry RPC after error@1268244366) -> (continuation of Deferred@300691017 after retry RPC after error@62569260) -> (continuation of Deferred@1092287134 after retry RPC after error@881079964) -> (continuation of Deferred@1147852835 after retry RPC after error@316635225) -> (continuation of Deferred@76005014 after retry RPC after error@287459404) -> (continuation of Deferred@52109707 after retry RPC after error@1794087937) -> (continuation of Deferred@1394994372 after retry RPC after error@1346813636) -> (continuation of Deferred@168544830 after retry RPC after error@470958314)))
12:16:58.449 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:58.469 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:58.474 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.474 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.474 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.474 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.474 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.474 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.474 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.474 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.475 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.475 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.475 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.475 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.475 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.533 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.534 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.534 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.534 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.534 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.534 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.534 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.534 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.534 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.534 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.534 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.534 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.534 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.594 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.125:34511(127.19.5.125:34511)] connecting to peer
12:16:58.594 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.124:34641(127.19.5.124:34641)] connecting to peer
12:16:58.594 [DEBUG - pool-466-thread-1] (Connection.java:748) [peer master-127.19.5.126:41267(127.19.5.126:41267)] connecting to peer
12:16:58.594 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.594 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.5.125:34511(127.19.5.125:34511)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.125:34511: Failed to connect to peer master-127.19.5.125:34511(127.19.5.125:34511): Connection refused: /127.19.5.125:34511
12:16:58.594 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.594 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.595 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.5.124:34641(127.19.5.124:34641)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.595 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.5.126:41267(127.19.5.126:41267)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.595 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.126:41267: Failed to connect to peer master-127.19.5.126:41267(127.19.5.126:41267): Connection refused: /127.19.5.126:41267
12:16:58.595 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.5.124:34641: Failed to connect to peer master-127.19.5.124:34641(127.19.5.124:34641): Connection refused: /127.19.5.124:34641
12:16:58.595 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.5.125:34511,127.19.5.124:34641,127.19.5.126:41267; will retry
12:16:58.598 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:58.613 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.613 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.613 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.614 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.614 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.614 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.614 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.614 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.614 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.614 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.693 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:58.694 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:58.694 [DEBUG - pool-474-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:58.694 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.694 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.694 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:58.694 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.694 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.694 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.694 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.694 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:58.694 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:58.694 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:58.695 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=22, TimeoutTracker(timeout=30000, elapsed=28467), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [17ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [17ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [28ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [28ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [61ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [63ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [91ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [91ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [165ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [165ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [181ms] refreshing cache from master, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [182ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [182ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [201ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [202ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [202ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [241ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [242ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [281ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [282ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [541ms] refreshing cache from master, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [541ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [542ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [543ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [961ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [962ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [962ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1180ms] refreshing cache from master, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1181ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1600ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1601ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1601ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [3500ms] refreshing cache from master, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [3501ms] too many traces: truncated at 100 traces, deferred=Deferred@179462024(state=PENDING, result=null, callback=(continuation of Deferred@225658975 after retry RPC after error@251489138) -> (continuation of Deferred@1995496881 after retry RPC after error@1848017656) -> (continuation of Deferred@2038439635 after retry RPC after error@482561130) -> (continuation of Deferred@1814959894 after retry RPC after error@918907177) -> (continuation of Deferred@1338675108 after retry RPC after error@1240214059) -> (continuation of Deferred@1432752807 after retry RPC after error@1215804675) -> (continuation of Deferred@1398518790 after retry RPC after error@2077126964) -> (continuation of Deferred@509126592 after retry RPC after error@1811076773) -> (continuation of Deferred@1703388249 after retry RPC after error@1841835532) -> (continuation of Deferred@913699538 after retry RPC after error@1271876935) -> (continuation of Deferred@330472715 after retry RPC after error@1067870527) -> (continuation of Deferred@652017531 after retry RPC after error@398994322) -> (continuation of Deferred@269854373 after retry RPC after error@477551113) -> (continuation of Deferred@1569769947 after retry RPC after error@198372672) -> (continuation of Deferred@911168017 after retry RPC after error@482566211) -> (continuation of Deferred@1204202513 after retry RPC after error@1533206852) -> (continuation of Deferred@401735651 after retry RPC after error@272061478) -> (continuation of Deferred@1650705429 after retry RPC after error@784818652) -> (continuation of Deferred@919706880 after retry RPC after error@476936600) -> (continuation of Deferred@1616004460 after retry RPC after error@1963856187) -> (continuation of Deferred@1326299911 after retry RPC after error@945531591), errback=(continuation of Deferred@225658975 after retry RPC after error@251489138) -> (continuation of Deferred@1995496881 after retry RPC after error@1848017656) -> (continuation of Deferred@2038439635 after retry RPC after error@482561130) -> (continuation of Deferred@1814959894 after retry RPC after error@918907177) -> (continuation of Deferred@1338675108 after retry RPC after error@1240214059) -> (continuation of Deferred@1432752807 after retry RPC after error@1215804675) -> (continuation of Deferred@1398518790 after retry RPC after error@2077126964) -> (continuation of Deferred@509126592 after retry RPC after error@1811076773) -> (continuation of Deferred@1703388249 after retry RPC after error@1841835532) -> (continuation of Deferred@913699538 after retry RPC after error@1271876935) -> (continuation of Deferred@330472715 after retry RPC after error@1067870527) -> (continuation of Deferred@652017531 after retry RPC after error@398994322) -> (continuation of Deferred@269854373 after retry RPC after error@477551113) -> (continuation of Deferred@1569769947 after retry RPC after error@198372672) -> (continuation of Deferred@911168017 after retry RPC after error@482566211) -> (continuation of Deferred@1204202513 after retry RPC after error@1533206852) -> (continuation of Deferred@401735651 after retry RPC after error@272061478) -> (continuation of Deferred@1650705429 after retry RPC after error@784818652) -> (continuation of Deferred@919706880 after retry RPC after error@476936600) -> (continuation of Deferred@1616004460 after retry RPC after error@1963856187) -> (continuation of Deferred@1326299911 after retry RPC after error@945531591)))
12:16:58.717 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.254:45345(127.13.164.254:45345)] connecting to peer
12:16:58.717 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.252:40513(127.13.164.252:40513)] connecting to peer
12:16:58.717 [DEBUG - pool-494-thread-1] (Connection.java:748) [peer master-127.13.164.253:36317(127.13.164.253:36317)] connecting to peer
12:16:58.717 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.717 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.717 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.13.164.254:45345(127.13.164.254:45345)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.717 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.717 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.13.164.252:40513(127.13.164.252:40513)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.718 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.13.164.253:36317(127.13.164.253:36317)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.718 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.252:40513: Failed to connect to peer master-127.13.164.252:40513(127.13.164.252:40513): Connection refused: /127.13.164.252:40513
12:16:58.718 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.254:45345: Failed to connect to peer master-127.13.164.254:45345(127.13.164.254:45345): Connection refused: /127.13.164.254:45345
12:16:58.718 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.13.164.253:36317: Failed to connect to peer master-127.13.164.253:36317(127.13.164.253:36317): Connection refused: /127.13.164.253:36317
12:16:58.718 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.13.164.254:45345,127.13.164.252:40513,127.13.164.253:36317; will retry
12:16:58.754 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.124:37703(127.23.110.124:37703)] connecting to peer
12:16:58.754 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.126:40817(127.23.110.126:40817)] connecting to peer
12:16:58.754 [DEBUG - pool-524-thread-1] (Connection.java:748) [peer master-127.23.110.125:35201(127.23.110.125:35201)] connecting to peer
12:16:58.754 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.754 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.754 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.754 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.110.124:37703(127.23.110.124:37703)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.754 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.110.125:35201(127.23.110.125:35201)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.754 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.110.126:40817(127.23.110.126:40817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.754 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.124:37703: Failed to connect to peer master-127.23.110.124:37703(127.23.110.124:37703): Connection refused: /127.23.110.124:37703
12:16:58.754 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.126:40817: Failed to connect to peer master-127.23.110.126:40817(127.23.110.126:40817): Connection refused: /127.23.110.126:40817
12:16:58.754 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.23.110.125:35201: Failed to connect to peer master-127.23.110.125:35201(127.23.110.125:35201): Connection refused: /127.23.110.125:35201
12:16:58.754 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.23.110.124:37703,127.23.110.126:40817,127.23.110.125:35201; will retry
12:16:58.769 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:58.770 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:58.770 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:58.770 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:58.770 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:58.770 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:58.770 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:58.770 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:58.770 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:58.770 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:58.770 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:58.770 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:58.770 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:58.810 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513018810 for job a80b2d6bcff6a8f46968361f50aad224.
12:16:58.816 [INFO - jobmanager-io-thread-1] (CheckpointCoordinator.java:1440) Completed checkpoint 11 for job a80b2d6bcff6a8f46968361f50aad224 (1968 bytes, checkpointDuration=6 ms, finalizationTime=0 ms).
12:16:58.817 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:411) Marking checkpoint 11 as completed for source Source: KuduSource.
12:16:58.834 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.61:36393(127.11.38.61:36393)] connecting to peer
12:16:58.834 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.60:33275(127.11.38.60:33275)] connecting to peer
12:16:58.834 [DEBUG - pool-456-thread-1] (Connection.java:748) [peer master-127.11.38.62:34839(127.11.38.62:34839)] connecting to peer
12:16:58.834 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.834 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.38.61:36393(127.11.38.61:36393)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.834 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.834 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.61:36393: Failed to connect to peer master-127.11.38.61:36393(127.11.38.61:36393): Connection refused: /127.11.38.61:36393
12:16:58.834 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.834 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.38.60:33275(127.11.38.60:33275)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.834 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.38.62:34839(127.11.38.62:34839)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.834 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.62:34839: Failed to connect to peer master-127.11.38.62:34839(127.11.38.62:34839): Connection refused: /127.11.38.62:34839
12:16:58.834 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.38.60:33275: Failed to connect to peer master-127.11.38.60:33275(127.11.38.60:33275): Connection refused: /127.11.38.60:33275
12:16:58.835 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.11.38.61:36393,127.11.38.60:33275,127.11.38.62:34839; will retry
12:16:58.949 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 1ca37d58d1e10dcfad9f21d692b10dbc since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 1ca37d58d1e10dcfad9f21d692b10dbc is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:58.968 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job c0988648dfcd43275159a42b4d64d13e since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job c0988648dfcd43275159a42b4d64d13e is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:59.023 [DEBUG - pool-464-thread-1] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=23, TimeoutTracker(timeout=30000, elapsed=30000), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [6ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [7ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [8ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [32ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [34ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [34ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [43ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [44ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [62ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [62ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [81ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [82ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [82ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [102ms] refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [141ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [142ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [143ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [184ms] refreshing cache from master, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [184ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [185ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [185ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [185ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [281ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [282ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [282ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [340ms] refreshing cache from master, [340ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [341ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [342ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [342ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [900ms] refreshing cache from master, [900ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [901ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [902ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [902ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2840ms] refreshing cache from master, [2840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [2841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.61:39401: Network error: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401, [2841ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.62:34269: Network error: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269, [2842ms] Sub RPC ConnectToMaster: received response from server master-127.11.220.60:40605: Network error: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [2842ms] delaying RPC due to: Service unavailable: Master config (127.11.220.61:39401,127.11.220.62:34269,127.11.220.60:40605) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.61:39401(127.11.220.61:39401): Connection refused: /127.11.220.61:39401,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.62:34269(127.11.220.62:34269): Connection refused: /127.11.220.62:34269,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.220.60:40605(127.11.220.60:40605): Connection refused: /127.11.220.60:40605, [3501ms] refreshing cache from master, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.61:39401, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.62:34269, [3501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.220.60:40605, [3502ms] too many traces: truncated at 100 traces, deferred=Deferred@104313931(state=PENDING, result=null, callback=(continuation of Deferred@28536391 after retry RPC after error@1009946250) -> (continuation of Deferred@420232912 after retry RPC after error@572675158) -> (continuation of Deferred@947504899 after retry RPC after error@278349912) -> (continuation of Deferred@1754598948 after retry RPC after error@1478850436) -> (continuation of Deferred@772993628 after retry RPC after error@74299982) -> (continuation of Deferred@1154052297 after retry RPC after error@933475971) -> (continuation of Deferred@236597817 after retry RPC after error@1741444734) -> (continuation of Deferred@1754021238 after retry RPC after error@1110546762) -> (continuation of Deferred@501604559 after retry RPC after error@404699819) -> (continuation of Deferred@301056851 after retry RPC after error@1606743022) -> (continuation of Deferred@1830130497 after retry RPC after error@213788202) -> (continuation of Deferred@332040117 after retry RPC after error@1802067361) -> (continuation of Deferred@715609110 after retry RPC after error@1465235486) -> (continuation of Deferred@283474542 after retry RPC after error@834713990) -> (continuation of Deferred@559373388 after retry RPC after error@1538823472) -> (continuation of Deferred@1614131747 after retry RPC after error@1410153258) -> (continuation of Deferred@1336129755 after retry RPC after error@1353561354) -> (continuation of Deferred@499429782 after retry RPC after error@539827567) -> (continuation of Deferred@1914309841 after retry RPC after error@1327690365) -> (continuation of Deferred@2010292750 after retry RPC after error@1071386622) -> (continuation of Deferred@495116368 after retry RPC after error@1173051527) -> (continuation of Deferred@667631846 after retry RPC after error@2016872478) -> (continuation of Deferred@1916663592 after retry RPC after error@1829615240), errback=(continuation of Deferred@28536391 after retry RPC after error@1009946250) -> (continuation of Deferred@420232912 after retry RPC after error@572675158) -> (continuation of Deferred@947504899 after retry RPC after error@278349912) -> (continuation of Deferred@1754598948 after retry RPC after error@1478850436) -> (continuation of Deferred@772993628 after retry RPC after error@74299982) -> (continuation of Deferred@1154052297 after retry RPC after error@933475971) -> (continuation of Deferred@236597817 after retry RPC after error@1741444734) -> (continuation of Deferred@1754021238 after retry RPC after error@1110546762) -> (continuation of Deferred@501604559 after retry RPC after error@404699819) -> (continuation of Deferred@301056851 after retry RPC after error@1606743022) -> (continuation of Deferred@1830130497 after retry RPC after error@213788202) -> (continuation of Deferred@332040117 after retry RPC after error@1802067361) -> (continuation of Deferred@715609110 after retry RPC after error@1465235486) -> (continuation of Deferred@283474542 after retry RPC after error@834713990) -> (continuation of Deferred@559373388 after retry RPC after error@1538823472) -> (continuation of Deferred@1614131747 after retry RPC after error@1410153258) -> (continuation of Deferred@1336129755 after retry RPC after error@1353561354) -> (continuation of Deferred@499429782 after retry RPC after error@539827567) -> (continuation of Deferred@1914309841 after retry RPC after error@1327690365) -> (continuation of Deferred@2010292750 after retry RPC after error@1071386622) -> (continuation of Deferred@495116368 after retry RPC after error@1173051527) -> (continuation of Deferred@667631846 after retry RPC after error@2016872478) -> (continuation of Deferred@1916663592 after retry RPC after error@1829615240)))
12:16:59.076 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:59.076 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:59.076 [DEBUG - pool-470-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:59.076 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.076 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.076 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.076 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.076 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.077 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.077 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.077 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.077 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.077 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:59.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.126:41849(127.14.239.126:41849)] connecting to peer
12:16:59.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.124:41311(127.14.239.124:41311)] connecting to peer
12:16:59.077 [DEBUG - pool-478-thread-1] (Connection.java:748) [peer master-127.14.239.125:46113(127.14.239.125:46113)] connecting to peer
12:16:59.077 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:59.077 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:59.077 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.14.239.126:41849(127.14.239.126:41849)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:59.077 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.14.239.124:41311(127.14.239.124:41311)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:59.077 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.124:41311: Failed to connect to peer master-127.14.239.124:41311(127.14.239.124:41311): Connection refused: /127.14.239.124:41311
12:16:59.077 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:59.077 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.126:41849: Failed to connect to peer master-127.14.239.126:41849(127.14.239.126:41849): Connection refused: /127.14.239.126:41849
12:16:59.077 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.14.239.125:46113(127.14.239.125:46113)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:59.077 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.14.239.125:46113: Failed to connect to peer master-127.14.239.125:46113(127.14.239.125:46113): Connection refused: /127.14.239.125:46113
12:16:59.077 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.14.239.126:41849,127.14.239.124:41311,127.14.239.125:46113; will retry
12:16:59.098 [INFO - Checkpoint Timer] (CheckpointFailureManager.java:109) Failed to trigger checkpoint for job 8680f415d5d255088cd51ec1e8014bb4 since Checkpoint triggering task Source: KuduSource -> Sink: Writer (1/4) of job 8680f415d5d255088cd51ec1e8014bb4 is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running..
12:16:59.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:59.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:59.110 [DEBUG - pool-484-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:59.110 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.110 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.110 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.110 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.110 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.110 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.110 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.110 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.110 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:59.112 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.252:41911(127.19.223.252:41911)] connecting to peer
12:16:59.113 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.253:37033(127.19.223.253:37033)] connecting to peer
12:16:59.113 [DEBUG - pool-468-thread-1] (Connection.java:748) [peer master-127.19.223.254:42193(127.19.223.254:42193)] connecting to peer
12:16:59.113 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.113 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.19.223.252:41911(127.19.223.252:41911)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.113 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.113 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.252:41911: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911
12:16:59.113 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.113 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.19.223.253:37033(127.19.223.253:37033)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.113 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.19.223.254:42193(127.19.223.254:42193)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.113 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.254:42193: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193
12:16:59.113 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.19.223.253:37033: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033
12:16:59.113 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193; will retry
12:16:59.114 [DEBUG - kudu-nio-4] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=26, TimeoutTracker(timeout=30000, elapsed=28946), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [15ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [16ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [21ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [42ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [42ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [101ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [102ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [113ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [113ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [130ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [131ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [141ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [142ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [142ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [161ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [162ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [162ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [181ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [181ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [221ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [221ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [261ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [261ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [262ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [262ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [321ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [321ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [321ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [322ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [440ms] refreshing cache from master, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [441ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [441ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [442ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [442ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [840ms] refreshing cache from master, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [841ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [842ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [842ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [842ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [940ms] refreshing cache from master, [940ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [941ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [941ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [942ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [942ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [942ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1400ms] refreshing cache from master, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [1401ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.252:41911: Network error: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.253:37033: Network error: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.19.223.254:42193: Network error: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [1402ms] delaying RPC due to: Service unavailable: Master config (127.19.223.252:41911,127.19.223.253:37033,127.19.223.254:42193) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.252:41911(127.19.223.252:41911): Connection refused: /127.19.223.252:41911,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.253:37033(127.19.223.253:37033): Connection refused: /127.19.223.253:37033,org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.19.223.254:42193(127.19.223.254:42193): Connection refused: /127.19.223.254:42193, [2861ms] refreshing cache from master, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.252:41911, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.253:37033, [2861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.19.223.254:42193, [2862ms] too many traces: truncated at 100 traces, deferred=Deferred@422989285(state=PENDING, result=null, callback=(continuation of Deferred@1650099021 after retry RPC after error@227177612) -> (continuation of Deferred@504658296 after retry RPC after error@904287802) -> (continuation of Deferred@59833120 after retry RPC after error@1575010762) -> (continuation of Deferred@1610788023 after retry RPC after error@1733456139) -> (continuation of Deferred@1671417658 after retry RPC after error@942320658) -> (continuation of Deferred@1295567028 after retry RPC after error@957751857) -> (continuation of Deferred@619568182 after retry RPC after error@1229631109) -> (continuation of Deferred@1111270000 after retry RPC after error@1253250988) -> (continuation of Deferred@16088736 after retry RPC after error@475514557) -> (continuation of Deferred@996137061 after retry RPC after error@1770239701) -> (continuation of Deferred@1109968187 after retry RPC after error@1617465837) -> (continuation of Deferred@632414581 after retry RPC after error@1374739976) -> (continuation of Deferred@1433786384 after retry RPC after error@1899416746) -> (continuation of Deferred@1537614256 after retry RPC after error@217162834) -> (continuation of Deferred@2009028740 after retry RPC after error@816552261) -> (continuation of Deferred@1525323073 after retry RPC after error@1530423674) -> (continuation of Deferred@1456370145 after retry RPC after error@985902028) -> (continuation of Deferred@873296200 after retry RPC after error@744926474) -> (continuation of Deferred@151158814 after retry RPC after error@783861561) -> (continuation of Deferred@1910531223 after retry RPC after error@1752668508) -> (continuation of Deferred@1978201660 after retry RPC after error@486635191) -> (continuation of Deferred@1874292060 after retry RPC after error@996058255) -> (continuation of Deferred@154528974 after retry RPC after error@530028433) -> (continuation of Deferred@1268696242 after retry RPC after error@86670226) -> (continuation of Deferred@601863269 after retry RPC after error@5739664), errback=(continuation of Deferred@1650099021 after retry RPC after error@227177612) -> (continuation of Deferred@504658296 after retry RPC after error@904287802) -> (continuation of Deferred@59833120 after retry RPC after error@1575010762) -> (continuation of Deferred@1610788023 after retry RPC after error@1733456139) -> (continuation of Deferred@1671417658 after retry RPC after error@942320658) -> (continuation of Deferred@1295567028 after retry RPC after error@957751857) -> (continuation of Deferred@619568182 after retry RPC after error@1229631109) -> (continuation of Deferred@1111270000 after retry RPC after error@1253250988) -> (continuation of Deferred@16088736 after retry RPC after error@475514557) -> (continuation of Deferred@996137061 after retry RPC after error@1770239701) -> (continuation of Deferred@1109968187 after retry RPC after error@1617465837) -> (continuation of Deferred@632414581 after retry RPC after error@1374739976) -> (continuation of Deferred@1433786384 after retry RPC after error@1899416746) -> (continuation of Deferred@1537614256 after retry RPC after error@217162834) -> (continuation of Deferred@2009028740 after retry RPC after error@816552261) -> (continuation of Deferred@1525323073 after retry RPC after error@1530423674) -> (continuation of Deferred@1456370145 after retry RPC after error@985902028) -> (continuation of Deferred@873296200 after retry RPC after error@744926474) -> (continuation of Deferred@151158814 after retry RPC after error@783861561) -> (continuation of Deferred@1910531223 after retry RPC after error@1752668508) -> (continuation of Deferred@1978201660 after retry RPC after error@486635191) -> (continuation of Deferred@1874292060 after retry RPC after error@996058255) -> (continuation of Deferred@154528974 after retry RPC after error@530028433) -> (continuation of Deferred@1268696242 after retry RPC after error@86670226) -> (continuation of Deferred@601863269 after retry RPC after error@5739664)))
12:16:59.284 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.190:46157(127.15.167.190:46157)] connecting to peer
12:16:59.284 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.188:40073(127.15.167.188:40073)] connecting to peer
12:16:59.284 [DEBUG - pool-480-thread-1] (Connection.java:748) [peer master-127.15.167.189:34023(127.15.167.189:34023)] connecting to peer
12:16:59.285 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.285 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.285 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.167.188:40073(127.15.167.188:40073)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.285 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.285 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.188:40073: Failed to connect to peer master-127.15.167.188:40073(127.15.167.188:40073): Connection refused: /127.15.167.188:40073
12:16:59.285 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.167.189:34023(127.15.167.189:34023)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.167.190:46157(127.15.167.190:46157)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.285 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.189:34023: Failed to connect to peer master-127.15.167.189:34023(127.15.167.189:34023): Connection refused: /127.15.167.189:34023
12:16:59.285 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.167.190:46157: Failed to connect to peer master-127.15.167.190:46157(127.15.167.190:46157): Connection refused: /127.15.167.190:46157
12:16:59.285 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.15.167.190:46157,127.15.167.188:40073,127.15.167.189:34023; will retry
12:16:59.310 [INFO - Checkpoint Timer] (CheckpointCoordinator.java:947) Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1783513019310 for job a80b2d6bcff6a8f46968361f50aad224.

Time: 299.96

OK (7 tests)

12:16:59.321 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.322 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
12:16:59.322 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
12:16:59.325 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.326 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:39737
12:16:59.328 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-26b930ec-c817-48d1-b2d0-608b2639e1ef
12:16:59.328 [INFO - FileChannelManagerImpl-netty-shuffle shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-9b2e0c5e-32c1-4051-b10c-fe07af9d79e3
12:16:59.328 [WARN - jobmanager-io-thread-2] (CheckpointFailureManager.java:114) Failed to trigger or complete checkpoint 12 for job a80b2d6bcff6a8f46968361f50aad224. (0 consecutive failed attempts so far)
org.apache.flink.runtime.checkpoint.CheckpointException: Failure to finalize checkpoint.
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1479)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1367)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1259)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$2(ExecutionGraphHandler.java:109)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$4(ExecutionGraphHandler.java:139)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.io.IOException: Could not flush and close the file system output stream to file:/tmp/junit16967090099317924946/checkpoints/a80b2d6bcff6a8f46968361f50aad224/chk-12/_metadata in order to obtain the stream state handle
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:149)
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:39)
	at org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:340)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1466)
	... 7 more
Caused by: java.io.IOException: Cannot clean commit: File has trailing junk data.
	at org.apache.flink.core.fs.local.LocalRecoverableFsDataOutputStream$LocalCommitter.commit(LocalRecoverableFsDataOutputStream.java:156)
	at org.apache.flink.runtime.state.filesystem.RecoverableStreamWrapper.closeForCommitAction(RecoverableStreamWrapper.java:46)
	at org.apache.flink.runtime.state.filesystem.MetadataOutputStreamWrapper.closeForCommit(MetadataOutputStreamWrapper.java:63)
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:130)
	... 10 more
12:16:59.330 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.330 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:318) Trying to recover from a global failure.
org.apache.flink.util.FlinkRuntimeException: Exceeded checkpoint tolerable failure threshold. The latest checkpoint failed due to Failure to finalize checkpoint., view the Checkpoint History tab or the Job Manager log to find out why continuous checkpoints failed.
	at org.apache.flink.runtime.checkpoint.CheckpointFailureManager.checkFailureAgainstCounter(CheckpointFailureManager.java:212)
	at org.apache.flink.runtime.checkpoint.CheckpointFailureManager.handleJobLevelCheckpointException(CheckpointFailureManager.java:169)
	at org.apache.flink.runtime.checkpoint.CheckpointFailureManager.handleCheckpointException(CheckpointFailureManager.java:122)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.abortPendingCheckpoint(CheckpointCoordinator.java:2268)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.abortPendingCheckpoint(CheckpointCoordinator.java:2247)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1479)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1367)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1259)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$2(ExecutionGraphHandler.java:109)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$4(ExecutionGraphHandler.java:139)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
12:16:59.331 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultScheduler.java:347) 4 tasks will be restarted to recover from a global failure.
12:16:59.331 [INFO - flink-pekko.actor.default-dispatcher-8] (DefaultExecutionGraph.java:1137) Job Flink Streaming Job (a80b2d6bcff6a8f46968361f50aad224) switched from state RUNNING to RESTARTING.
12:16:59.331 [WARN - jobmanager-io-thread-2] (ExecutionGraphHandler.java:141) Error while processing AcknowledgeCheckpoint message
org.apache.flink.runtime.checkpoint.CheckpointException: Could not finalize the pending checkpoint 12. Failure reason: Failure to finalize checkpoint.
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1485)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1367)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1259)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$2(ExecutionGraphHandler.java:109)
	at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$4(ExecutionGraphHandler.java:139)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: java.io.IOException: Could not flush and close the file system output stream to file:/tmp/junit16967090099317924946/checkpoints/a80b2d6bcff6a8f46968361f50aad224/chk-12/_metadata in order to obtain the stream state handle
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:149)
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:39)
	at org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:340)
	at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1466)
	... 7 more
Caused by: java.io.IOException: Cannot clean commit: File has trailing junk data.
	at org.apache.flink.core.fs.local.LocalRecoverableFsDataOutputStream$LocalCommitter.commit(LocalRecoverableFsDataOutputStream.java:156)
	at org.apache.flink.runtime.state.filesystem.RecoverableStreamWrapper.closeForCommitAction(RecoverableStreamWrapper.java:46)
	at org.apache.flink.runtime.state.filesystem.MetadataOutputStreamWrapper.closeForCommit(MetadataOutputStreamWrapper.java:63)
	at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.closeAndFinalizeCheckpoint(FsCheckpointMetadataOutputStream.java:130)
	... 10 more
12:16:59.331 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (4/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:16:59.331 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 3 (#0) of source Source: KuduSource.
12:16:59.332 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:16:59.332 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 2 (#0) of source Source: KuduSource.
12:16:59.332 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:16:59.332 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 1 (#0) of source Source: KuduSource.
12:16:59.332 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:16:59.332 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:331) Removing registered reader after failure for subtask 0 (#0) of source Source: KuduSource.
12:16:59.333 [INFO - SourceCoordinator-Source: KuduSource] (SourceCoordinator.java:426) Marking checkpoint 12 as aborted for source Source: KuduSource.
12:16:59.334 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:16:59.335 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0) switched from RUNNING to CANCELING.
12:16:59.335 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (4/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_3_0).
12:16:59.338 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-7bb8dd6e-c367-4ac0-b327-781a8583ce21
12:16:59.338 [INFO - TransientBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.339 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state TERMINATED
12:16:59.339 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state TERMINATED
12:16:59.339 [DEBUG - Source: KuduSource -> Sink: Writer (4/4)#0] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state TERMINATED
12:16:59.339 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:59.340 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:59.340 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
12:16:59.351 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
12:16:59.352 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
12:16:59.352 [INFO - TaskExecutorStateChangelogStoragesManager shutdown hook] (TaskExecutorStateChangelogStoragesManager.java:234) Shutting down TaskExecutorStateChangelogStoragesManager.
12:16:59.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:16:59.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from RUNNING to CANCELING.
12:16:59.353 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:16:59.353 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.354 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:16:59.354 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:16:59.354 [INFO - Source: KuduSource -> Sink: Writer (4/4)#0] (SplitFetcher.java:316) Shutting down split fetcher 0
12:16:59.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state TERMINATED
12:16:59.355 [INFO - PermanentBlobCache shutdown hook] (AbstractBlobCache.java:251) Shutting down BLOB cache
12:16:59.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state TERMINATED
12:16:59.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state TERMINATED
12:16:59.355 [DEBUG - Source: KuduSource -> Sink: Writer (3/4)#0] (Connection.java:575) [peer 60f38d7e54994965809690b5a8afb3b1(127.24.66.3:36399)] disconnecting while in state TERMINATED
12:16:59.355 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:59.356 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:59.356 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 26 thread-local buffer(s) from thread: kudu-nio-2
12:16:59.356 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 17 thread-local buffer(s) from thread: kudu-nio-0
12:16:59.357 [INFO - FileCache shutdown hook] (FileCache.java:160) removed file cache directory /tmp/flink-dist-cache-a33bdb71-61aa-4252-9214-f82a29b41fae
12:16:59.357 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-f01eced7-ec2b-45b1-aa67-10878f5fb794
12:16:59.357 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-a5604d1a-6b98-41b1-8826-6bd79cb2b90b
12:16:59.359 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
12:16:59.360 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-f5ea2b96-a4c9-4ae5-ac4d-ad23abb9a8e4
12:16:59.361 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:16:59.361 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from RUNNING to CANCELING.
12:16:59.361 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:16:59.361 [DEBUG - kudu-nio-3] (PoolThreadCache.java:218) Freed 22 thread-local buffer(s) from thread: kudu-nio-3
12:16:59.361 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:16:59.361 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:16:59.361 [INFO - Source: KuduSource -> Sink: Writer (3/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (3/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0).
12:16:59.362 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state TERMINATED
12:16:59.362 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state TERMINATED
12:16:59.362 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state TERMINATED
12:16:59.362 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
12:16:59.362 [DEBUG - Source: KuduSource -> Sink: Writer (2/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:59.363 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:59.363 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 25 thread-local buffer(s) from thread: kudu-nio-2
12:16:59.363 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:16:59.364 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1145) Attempting to cancel task Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:16:59.364 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
12:16:59.364 [INFO - flink-pekko.actor.default-dispatcher-6] (Task.java:1210) Triggering cancellation of task code Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:16:59.364 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
12:16:59.365 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
12:16:59.365 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.24.66.62:39483(127.24.66.62:39483)] disconnecting while in state TERMINATED
12:16:59.366 [INFO - TaskExecutorFileMergingManager shutdown hook] (TaskExecutorFileMergingManager.java:126) Shutting down TaskExecutorFileMergingManager.
12:16:59.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.24.66.60:33469(127.24.66.60:33469)] disconnecting while in state TERMINATED
12:16:59.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (Connection.java:575) [peer master-127.24.66.61:43045(127.24.66.61:43045)] disconnecting while in state TERMINATED
12:16:59.366 [DEBUG - Source: KuduSource -> Sink: Writer (1/4)#0] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:16:59.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:16:59.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:16:59.366 [INFO - Source: KuduSource -> Sink: Writer (2/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (2/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0).
12:16:59.366 [DEBUG - kudu-nio-1] (PoolThreadCache.java:218) Freed 18 thread-local buffer(s) from thread: kudu-nio-1
12:16:59.367 [DEBUG - kudu-nio-2] (PoolThreadCache.java:218) Freed 24 thread-local buffer(s) from thread: kudu-nio-2
12:16:59.367 [DEBUG - kudu-nio-0] (PoolThreadCache.java:218) Freed 20 thread-local buffer(s) from thread: kudu-nio-0
12:16:59.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (SourceReaderBase.java:338) Closing Source Reader.
12:16:59.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:1090) Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:16:59.368 [INFO - Source: KuduSource -> Sink: Writer (1/4)#0] (Task.java:835) Freeing task resources for Source: KuduSource -> Sink: Writer (1/4)#0 (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
12:16:59.369 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (3/4)#0 ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0.
12:16:59.370 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (2/4)#0 ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0.
12:16:59.370 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (3/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_2_0) switched from CANCELING to CANCELED.
12:16:59.370 [INFO - flink-pekko.actor.default-dispatcher-6] (TaskExecutor.java:2037) Un-registering task and sending final execution state CANCELED to JobManager for task Source: KuduSource -> Sink: Writer (1/4)#0 ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
12:16:59.370 [INFO - FileChannelManagerImpl-io shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-efab2892-71a9-427e-8e3d-8e4608ae0ad7
12:16:59.371 [INFO - flink-pekko.actor.default-dispatcher-6] (FineGrainedSlotManager.java:324) Received resource requirements from job a80b2d6bcff6a8f46968361f50aad224: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
12:16:59.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (2/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_1_0) switched from CANCELING to CANCELED.
12:16:59.371 [INFO - TaskExecutorLocalStateStoresManager shutdown hook] (TaskExecutorLocalStateStoresManager.java:314) Shutting down TaskExecutorLocalStateStoresManager.
12:16:59.371 [INFO - flink-pekko.actor.default-dispatcher-8] (Execution.java:1442) Source: KuduSource -> Sink: Writer (1/4) (ab09ebb9aacd7d0cdc67b9c74f7dc2a0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
12:16:59.371 [INFO - IOManagerAsync shutdown hook] (FileChannelManagerImpl.java:149) FileChannelManager removed spill file directory /tmp/flink-io-60c2557c-d99f-4ddb-a2ff-df8ed200970d
12:16:59.372 [INFO - BlobServer shutdown hook] (BlobServer.java:401) Stopped BLOB server at 0.0.0.0:43109
12:16:59.372 [INFO - flink-pekko.actor.default-dispatcher-8] (FineGrainedSlotManager.java:324) Received resource requirements from job a80b2d6bcff6a8f46968361f50aad224: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
